-- Logs begin at Tue 2022-02-15 02:20:48 UTC, end at Tue 2022-02-15 03:24:16 UTC. -- Feb 15 02:53:45.987226 dv-cinder-828085-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 15 02:53:45.996097 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 02:53:45 2022] *** Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: nodename: dv-cinder-828085-9-iscsi Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: machine: x86_64 Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: clock source: unix Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: pcre jit disabled Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: detected number of CPU cores: 4 Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: current working directory: / Feb 15 02:53:45.998103 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: detected binary path: /usr/bin/uwsgi-core Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: your processes number limit is 47680 Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: your memory page size is 4096 bytes Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: detected max file descriptor number: 2048 Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: lock engine: pthread robust mutexes Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: thunder lock: enabled Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 15 02:53:45.998796 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 02:53:46.044384 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: Python main interpreter initialized at 0x5634059c59c0 Feb 15 02:53:46.044384 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: python threads support enabled Feb 15 02:53:46.044384 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: your server socket listen backlog is limited to 100 connections Feb 15 02:53:46.044384 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: your mercy for graceful operations on workers is 90 seconds Feb 15 02:53:46.044799 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 02:53:46.044799 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: *** Operational MODE: preforking *** Feb 15 02:53:46.045087 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: *** uWSGI is running in multiple interpreter mode *** Feb 15 02:53:46.045087 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: spawned uWSGI master process (pid: 101918) Feb 15 02:53:46.045321 dv-cinder-828085-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 15 02:53:46.046436 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: spawned uWSGI worker 1 (pid: 101919, cores: 1) Feb 15 02:53:46.046436 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: spawned uWSGI worker 2 (pid: 101920, cores: 1) Feb 15 02:53:46.046436 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 02:53:47.881587 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 02:53:47.881587 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: from cryptography.utils import int_from_bytes Feb 15 02:53:47.882269 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 02:53:47.882269 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: from cryptography.utils import int_from_bytes Feb 15 02:53:47.882384 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 02:53:47.882384 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: from cryptography.utils import int_from_bytes Feb 15 02:53:47.882805 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 02:53:47.882805 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: from cryptography.utils import int_from_bytes Feb 15 02:53:50.563219 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 02:53:50.563721 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 02:53:50.563888 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 02:53:50.564264 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 02:53:50.564527 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 02:53:50.564928 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.565260 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.565354 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 02:53:50.565705 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 02:53:50.565800 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.565887 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.566034 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 02:53:50.566229 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.566406 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 02:53:50.566547 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.566671 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 02:53:50.566876 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.567064 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.567237 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.567424 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.567574 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.567758 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.567851 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.568116 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.568214 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.568455 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.568705 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828085-9-iscsi {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.568849 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.569041 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.569193 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.569357 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.569525 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.569677 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.569866 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570010 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570136 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570318 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570464 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570650 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570795 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828085-9-iscsi {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.570961 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.571129 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.571468 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.571556 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.571790 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.571939 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.572121 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.572256 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.572434 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.572560 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.572764 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.572901 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.573094 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.573215 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.573530 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.573617 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.573862 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.573964 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.574179 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.574285 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.574501 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.574596 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.574853 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.574921 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.575174 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.575280 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828085-9-iscsi {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.575491 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.575585 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.575825 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.575952 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.576146 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.576253 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.576475 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.576568 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.576793 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.576893 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.577168 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.577253 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828085-9-iscsi {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.577498 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.577594 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.577833 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.577941 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.578146 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.578236 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.578480 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.578570 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.578805 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.578907 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.579130 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.579247 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.579481 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.579576 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.579798 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.579895 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.580114 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.580206 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.580432 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.580526 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.580756 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.580851 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581067 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581153 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581380 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581481 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581636 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581729 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.581953 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.582038 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.582283 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.582379 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.582611 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.582696 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.582922 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.583012 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.583208 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.583308 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.583488 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.583573 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.583946 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.584055 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.584279 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.584414 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.584600 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.584699 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.584915 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585032 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585229 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585323 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585545 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585630 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585859 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.585950 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.586173 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.586259 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.586490 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.586575 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.586805 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.586896 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.587121 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.587267 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.587466 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.587552 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.587791 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.587877 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.588105 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.588197 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.588420 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.588504 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.588738 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.588832 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.589066 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.589162 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.589380 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.589465 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.589709 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.589873 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.590026 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.590118 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.590352 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.590476 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.590681 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.590774 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.591004 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.591087 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.591347 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.591444 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.591667 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.591761 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.592238 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.592336 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.592566 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.592655 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.592893 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.592978 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.593206 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.593300 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.593463 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.593558 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.593772 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.593859 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.594085 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.594178 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.594413 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.594497 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.594727 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.594813 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595040 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595136 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595356 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595442 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595671 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595764 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.595981 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.596075 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.596296 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.596391 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.596610 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.596702 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.596922 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597005 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597234 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597336 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597541 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597625 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597855 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.597939 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.598169 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.598266 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.598482 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.598567 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.598799 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.598887 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.599113 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.599238 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.599960 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.600095 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.600279 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.600372 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.600595 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.600727 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.600910 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601004 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601235 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601319 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601549 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601644 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601861 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.601944 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.602208 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.602300 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.602489 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.602629 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.602802 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.602887 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.603121 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.603274 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.603457 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.603559 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.603768 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.603893 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.604821 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.604967 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.605056 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.605152 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.605280 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.605371 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.605492 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.605626 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.606467 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.606663 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.607617 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.607701 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.607873 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.607959 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608048 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608127 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608401 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608495 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608574 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608704 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608810 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608898 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.608984 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609062 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609138 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609221 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609311 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609390 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609467 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609543 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609629 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609715 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609801 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.609920 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610008 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610087 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610167 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610252 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610350 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.610496 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610590 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.610670 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610670 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.610817 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.610946 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.611029 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.611106 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.611199 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.611399 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 02:53:50.611499 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.611744 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.611830 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.612083 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.612175 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.612403 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.612487 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.612736 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.612821 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.613056 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.613139 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.613378 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.613465 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.613698 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.613789 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.614015 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.614098 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.614336 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.614422 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.614669 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.614761 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.615632 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.615747 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.615966 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.616051 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.616296 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.616471 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.616619 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.616706 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.616943 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.617036 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.617278 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.617364 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.617608 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.617694 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.617926 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618014 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618254 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618337 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618581 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618675 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618908 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.618994 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.619262 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.619359 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.619595 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.619687 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.619913 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.619997 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.620234 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.620318 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.620563 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.620646 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.620896 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.620972 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.621226 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.621301 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.621545 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.621668 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.621868 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.621979 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.622196 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.622333 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.622501 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.622588 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.622818 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.622906 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.623139 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.623237 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.623480 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.623564 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.623805 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.623890 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.624130 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.624204 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.624450 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.624533 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.624807 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.624894 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.625086 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.625172 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.625403 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.625488 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.625720 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.625803 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626037 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626121 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626351 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626436 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626665 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626749 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.626979 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.627073 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.627323 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.627422 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.627636 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.627722 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.627953 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628054 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628273 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628359 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628585 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628669 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628898 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.628997 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.629218 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.629310 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.629534 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.629619 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.629852 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.629938 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.630196 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.630294 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.630512 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.630600 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.630859 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.630944 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.631204 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.631289 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.631523 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.631619 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.631847 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.631923 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.632170 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.632245 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.632487 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.632560 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.632808 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.632947 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.633130 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.633206 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.633444 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.633528 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.633777 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.633852 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.634098 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.634182 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.634411 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.634504 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.634730 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.634823 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.635043 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.635131 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.635398 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.635499 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.635721 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.635807 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.636063 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.636150 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.636382 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.636481 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.636704 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.636791 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.637039 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.637131 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.637363 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.637449 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.637690 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.637790 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.638028 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.638127 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.638374 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.638469 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.638692 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.638779 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.639029 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.639125 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.639392 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.639518 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.639713 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.639799 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640025 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640109 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640337 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640429 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640648 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640741 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.640959 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.641052 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.641269 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.641641 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.641769 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.641876 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.641980 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642161 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642270 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642375 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642487 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642575 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642782 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.642877 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.643094 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.643202 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.643447 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.643545 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.643766 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.643862 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.644078 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.644165 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.644389 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.644483 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.644699 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.644786 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.645049 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.645162 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.645367 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.645453 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.645683 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.645770 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.646008 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.646642 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.646912 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.647000 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.647302 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.647394 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.647632 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.647728 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.647952 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.648043 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.648309 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.648395 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.648700 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.648783 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649021 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649112 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649348 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649441 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649680 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649772 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.649996 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.650094 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.650322 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.650407 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.650653 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.650737 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.650987 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.651081 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.651342 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.651440 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.651672 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.651758 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.651992 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.652088 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.652318 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.652402 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.652633 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.652718 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.652952 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.653050 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.653267 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.653369 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.653584 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.653670 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.653911 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654045 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654232 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654318 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654550 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654636 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654867 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.654962 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.655211 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.655300 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.655525 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.655620 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.655849 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.655942 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.656164 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.656250 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.656487 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.656571 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.656822 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.656908 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.657160 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.657244 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.657480 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.657572 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.657800 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.657888 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.658129 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.658214 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.658445 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.658539 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.658764 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.658857 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.659086 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.659184 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.659427 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.659524 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.659740 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.659826 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.660059 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.660144 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.660380 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.660476 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.660697 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.660782 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.661016 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.661108 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.661325 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.661419 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.661636 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.661738 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.662507 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.662724 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.662820 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.663051 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.663182 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.663463 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.663549 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.663776 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.663873 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.664103 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.664192 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.664419 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.664512 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.664734 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.664829 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665046 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665132 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665359 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665443 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665672 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665771 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.665994 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.666078 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.666310 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.666395 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.666621 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.666708 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.666933 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.667064 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.667266 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.667354 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.667600 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.667694 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.667921 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668006 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668230 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668315 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668543 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668636 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668855 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.668940 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.669172 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.669257 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.669494 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.669581 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.669811 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.669896 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.670130 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.670224 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.670460 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.670545 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.670777 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.670868 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.671099 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.671222 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.671444 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.671536 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.671764 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.672419 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.672527 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.672614 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.672905 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.673000 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.673781 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.673867 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.673993 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.674205 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.674205 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.674835 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.674835 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.674957 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.675038 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.675107 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.676118 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.676250 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.676329 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.676329 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.676463 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.676948 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.677023 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.677088 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.677153 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.677217 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.677855 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.677930 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.678003 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.678071 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.678951 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.678951 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679087 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679175 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679245 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679324 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679391 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679464 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679636 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679723 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679799 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679876 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.679876 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.680634 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.680723 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.680888 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.680976 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681054 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681132 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681209 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681301 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681382 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681593 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681675 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681762 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681850 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.681937 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682024 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682132 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682217 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682295 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682418 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682513 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682738 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.682824 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.683052 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.683138 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.683402 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.683492 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.683718 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.683805 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684034 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684122 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684350 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684434 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684663 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684749 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.684974 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.685057 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.685449 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.685559 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.685650 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.685732 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.685912 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686020 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686244 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686352 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686563 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686658 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686878 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.686964 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.687212 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.687319 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.687527 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.687620 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.687879 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.687966 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.688195 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.688293 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.688506 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.688591 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.688828 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.688915 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.689148 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.689243 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.689459 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.689544 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.689777 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.689869 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.690096 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.690205 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.690417 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.690510 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.690729 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.690821 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.691044 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.691131 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.691388 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.691472 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.691702 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.691800 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692013 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692098 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692328 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692416 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692640 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692734 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.692986 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.693072 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.693353 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.693465 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.693672 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.693804 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.693985 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.694102 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.694303 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.694421 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.694615 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.694747 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.694941 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.695065 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.695287 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.695407 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.695655 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.695760 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.695901 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.696029 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.696240 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.696371 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.696641 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.696774 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.696898 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697022 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697145 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697269 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697456 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697585 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697770 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.697898 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.698083 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.698219 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.698422 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.698549 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.698699 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.698828 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699009 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699145 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699356 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699487 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699689 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699868 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.699995 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.700127 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.700311 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.700438 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.700622 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.700750 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.700937 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.701071 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.701247 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.701379 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.701559 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.701685 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.701872 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702008 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702180 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702292 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702492 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702606 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702802 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.702941 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.703112 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.703285 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.703447 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.703574 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.703761 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.703893 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.704074 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.704201 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.704380 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.704506 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.704692 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.704820 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705000 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705127 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705310 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705436 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705627 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705745 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.705939 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706047 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706267 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706377 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706588 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706684 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706899 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.706995 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.707232 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.707335 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.707544 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.707630 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.707864 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.707955 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.708177 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.708271 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.708501 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.708586 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.709377 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.709475 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.709703 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.709798 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710033 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710138 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710352 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710437 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710674 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710777 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.710988 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.711073 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.711327 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.711415 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.711654 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.711749 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.711977 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.712062 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.712300 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.712392 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.712609 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.712695 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.712918 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713001 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713234 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713319 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713551 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713644 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713867 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.713952 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.714187 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.714275 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.714505 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.714600 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.714824 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.714923 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.715135 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.715256 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.715473 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.715595 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.715813 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.715913 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.716104 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.716202 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.716422 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.716515 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.716740 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.717122 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.717298 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.717396 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.717615 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.717701 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.717932 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718024 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718241 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718335 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718560 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718646 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718873 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.718957 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.719208 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.719311 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.719523 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.719616 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.719835 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.719969 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.720172 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.720286 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.720492 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.720585 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.720808 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.720899 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.721127 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.721219 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.721441 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.721530 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.721761 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.721849 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.722073 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.722206 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.722411 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.722538 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.722822 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.722948 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.723138 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.723309 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.723474 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.723600 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.723790 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.723926 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.724105 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.724252 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.724483 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.724676 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.724873 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725093 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725283 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725423 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725550 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725673 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725796 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.725995 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.726246 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.726386 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.726568 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.728816 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.728991 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729098 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729182 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729268 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729349 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729533 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729634 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729727 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729856 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729985 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.729985 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.730299 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.730595 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.730751 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.730892 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731029 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731193 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731348 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731497 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731662 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731662 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.731901 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732032 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732187 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732341 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732489 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732627 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732762 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.732903 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733060 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733201 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733332 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733482 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733605 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733749 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.733927 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734069 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734229 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734350 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734499 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734632 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734766 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.734900 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735048 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735230 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735373 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735503 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735639 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735771 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.735922 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.736062 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.736278 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.736432 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.736563 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.736702 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.736865 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737008 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737159 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737294 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737419 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737570 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737705 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737842 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.737973 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738102 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738235 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738381 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738523 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738658 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738790 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.738928 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.739067 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.739255 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.739389 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.739519 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.739651 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.739787 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.740449 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.740670 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.740832 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.740968 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741084 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741164 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741241 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741323 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741389 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741461 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741527 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741615 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741615 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741798 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741865 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.741936 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.742135 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.742253 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.742446 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.742534 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.742757 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.742842 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.743073 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.743199 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.743414 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.743504 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.743745 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.743892 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.744074 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.744176 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.744409 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.744495 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.744724 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.744810 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745056 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745155 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745371 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745457 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745684 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745774 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.745999 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.746099 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.746312 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.746396 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.746653 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.746738 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.746966 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.747059 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.747308 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.747441 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.747621 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.747707 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.747942 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.748030 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.748254 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.748340 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.748566 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.748651 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.748876 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749002 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749192 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749278 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749502 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749588 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749813 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.749906 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.750121 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.750207 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.750447 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.750539 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.750758 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.750840 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.751068 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.751206 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.751403 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.751507 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.751716 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.751801 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752027 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752112 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752335 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752428 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752648 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752733 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.752961 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.753065 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.753925 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754042 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754125 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754310 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754395 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754595 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754676 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754763 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754852 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.754932 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755011 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755096 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755218 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755309 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755471 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755709 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.755850 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.756115 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.756350 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.756477 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.756682 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.756768 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.757015 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.757102 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.757782 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.757888 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.757888 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758253 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758343 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758423 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758504 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758591 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758678 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.758758 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.759067 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.759274 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.759422 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.759509 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.759749 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.759834 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.760076 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.760171 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.760405 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.760504 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761419 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761525 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761603 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761692 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761781 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761913 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.761913 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.762126 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.762242 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.762952 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.763183 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.763286 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.763380 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.763461 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.765849 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.765940 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766023 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766104 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766187 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766275 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766369 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766451 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766587 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766676 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766756 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766844 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.766932 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767000 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767078 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767164 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767259 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767543 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767642 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767712 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767777 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767865 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.767945 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768031 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768112 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768190 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768267 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768346 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768432 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768521 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768602 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768679 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768764 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768764 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.768929 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769012 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769090 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769168 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769233 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769310 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769377 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769464 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769553 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769798 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.769886 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.770120 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.770207 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.770436 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.770520 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.770756 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.770841 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.771674 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.771824 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.771981 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.772282 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.772548 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.772660 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.772749 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.772917 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.773005 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.773251 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.773337 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.773580 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.773667 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.773909 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774008 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774223 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774312 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774546 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774634 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774856 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.774942 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.775186 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.775431 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.775535 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.775758 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.775844 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.776099 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.776183 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.776430 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.776517 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.776748 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.776839 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.777061 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.777147 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.777382 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.777468 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.777699 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.777827 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.778015 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.778326 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.778439 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.778599 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.778792 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.778927 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.779005 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.779262 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.779382 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.779593 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.779719 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.779914 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.780048 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.780226 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.780364 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.780554 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.780696 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.780871 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.781011 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.781326 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.781429 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.781650 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.781761 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.781969 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.782089 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.782282 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.782427 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.782601 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.782763 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.782921 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.783088 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.783265 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.783431 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.783578 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.783766 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.783897 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.784080 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.784208 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.784402 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.784543 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.784722 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.784858 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785061 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785163 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785356 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785473 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785640 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785790 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.785962 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.786102 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.786283 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.786412 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.786597 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.786838 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.787478 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.787770 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.787897 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.787966 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.788109 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.788276 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.788428 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.788594 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.788743 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.788904 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.789058 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.789224 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.789378 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.789537 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.789691 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.789858 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790004 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790170 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790321 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790557 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790644 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790871 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.790967 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.791267 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.791370 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.791533 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.791620 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.791857 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.791954 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.792187 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.792275 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.792497 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.792590 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.792818 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.792913 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.793130 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.793217 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.793479 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.793572 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.793811 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.794042 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.794131 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.794385 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.794485 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.794717 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.794805 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.795053 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.795140 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.795398 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.795488 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.795717 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.795811 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.796033 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.796121 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.796345 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.796432 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.796678 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.796927 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.797014 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.797274 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.797369 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.797608 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.797704 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.797926 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798014 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798248 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798334 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798569 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798673 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798889 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.798977 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.799229 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.799330 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.799548 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.799693 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.799868 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.799956 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.800185 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.800272 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.800504 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.800599 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.800825 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.800912 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.801146 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.801231 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.801474 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.801582 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.801793 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.801878 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.802112 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.802197 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.802465 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.802609 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.802785 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.802920 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.803097 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.803242 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.803441 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.803530 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.803765 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.803852 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.804102 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.804186 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.804418 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.804505 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.804731 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.804816 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.805054 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.805156 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.805372 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.805459 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.805689 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.805774 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806007 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806102 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806323 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806399 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806646 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806729 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.806984 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.807069 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.807329 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.807410 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.807647 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.807722 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.807981 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.808085 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.808316 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.808391 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.808661 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.808735 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.808994 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.809071 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.809324 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.809402 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.809637 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.809721 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.809947 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810034 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810259 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810344 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810576 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810660 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810896 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.810971 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.811254 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.811341 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.811583 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.811760 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.811910 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.811987 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.812231 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.812324 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.812541 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.812652 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.812858 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.812965 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.813170 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.813305 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.813487 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.813572 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815394 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815508 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815593 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815693 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815693 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815851 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815851 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.815982 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816047 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816118 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816198 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816265 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816329 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816392 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816462 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816528 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816605 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816672 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816737 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816809 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.816973 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.817058 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.817284 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.817376 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.817617 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.817703 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.817932 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.818047 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.818328 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.818418 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.818647 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.818732 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.818967 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.819062 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.819313 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.819437 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.819651 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.819759 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.819985 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.820085 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.820300 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.820405 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.820634 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.820708 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.820957 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.821044 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.821282 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.821358 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.821643 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.821742 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.821922 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822000 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822290 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822381 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822571 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822662 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822893 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.822969 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.823265 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.823376 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.823553 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.823647 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.823877 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.823953 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.824201 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.824276 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.824537 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.824622 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.824858 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.824941 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.825109 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 02:53:50.825197 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.825504 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.825860 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.826181 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.826534 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.826870 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.827212 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.827534 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.827844 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 02:53:50.828101 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 02:53:50.848970 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_db.sqlalchemy.engines [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:50.853142 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:50.915552 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.context [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f961b14e-12e5-47a3-bada-8b53b85b0202(cell1) {{(pid=101920) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 02:53:50.919887 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_concurrency.lockutils [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 02:53:50.921494 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_concurrency.lockutils [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 02:53:50.922334 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.context [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f961b14e-12e5-47a3-bada-8b53b85b0202(cell1) {{(pid=101919) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 02:53:50.922442 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_concurrency.lockutils [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 02:53:50.924388 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_concurrency.lockutils [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 02:53:50.926570 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 02:53:50.928812 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 02:53:50.929808 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 02:53:50.931795 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 02:53:50.935898 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_db.sqlalchemy.engines [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:50.938047 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_db.sqlalchemy.engines [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:50.947834 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:50.949231 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:51.104770 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG oslo_db.sqlalchemy.engines [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:51.113537 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 02:53:51.454135 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: WARNING keystonemiddleware.auth_token [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 02:53:51.457046 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 02:53:51.460882 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: WARNING keystonemiddleware.auth_token [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 02:53:51.464205 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 02:53:51.806218 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: WARNING keystonemiddleware.auth_token [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 02:53:51.811485 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: WARNING keystonemiddleware.auth_token [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 02:53:51.816638 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634059c59c0 pid: 101920 (default app) Feb 15 02:53:51.819508 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:53:51.820715 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002533 Feb 15 02:53:51.821115 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Tue Feb 15 02:53:51 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:53:51.824166 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 02:53:51.829346 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-39f1f1ee-a10b-4f66-a67e-495f482fe179 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 02:53:51.835366 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634059c59c0 pid: 101919 (default app) Feb 15 02:55:19.610308 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:19.611595 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Feb 15 02:55:19.612498 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:20.131486 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-e6b7a3a3-f3a2-4d2a-867c-1ab9efa138b0 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:20.166214 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-e6b7a3a3-f3a2-4d2a-867c-1ab9efa138b0 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.541417 Feb 15 02:55:20.166903 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Feb 15 02:55:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:55:22.628519 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:22.629525 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ea25fb43-0480-435b-8086-1b193e3f904e None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Feb 15 02:55:22.630230 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:22.701630 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-62373c09-671f-4056-8c78-73381d2896a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "ram": 256, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:22.720907 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 02:55:22.720907 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Feb 15 02:55:22.751798 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-62373c09-671f-4056-8c78-73381d2896a4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111215 Feb 15 02:55:22.755251 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:22.988975 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-325d19b7-efd0-401d-afc7-a2aa48f9440a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:22.992336 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 02:55:22.992336 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: warnings.warn(msg) Feb 15 02:55:23.041695 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-325d19b7-efd0-401d-afc7-a2aa48f9440a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275998 Feb 15 02:55:23.042284 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Feb 15 02:55:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 02:55:25.422134 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-62373c09-671f-4056-8c78-73381d2896a4 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:25.423181 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-62373c09-671f-4056-8c78-73381d2896a4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Feb 15 02:55:25.423609 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:25.565578 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-75dbeb57-2599-40a4-a631-247121e890ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:25.590537 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 02:55:25.590537 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: warnings.warn(msg) Feb 15 02:55:25.617108 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-75dbeb57-2599-40a4-a631-247121e890ce admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.185764 Feb 15 02:55:25.618028 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:25.637951 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c8bfba58-8ca4-4df9-954f-c3c83236e3a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:25.640762 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 02:55:25.640762 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Feb 15 02:55:25.690626 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-c8bfba58-8ca4-4df9-954f-c3c83236e3a6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059488 Feb 15 02:55:25.691249 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Feb 15 02:55:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 02:55:28.150766 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-75dbeb57-2599-40a4-a631-247121e890ce admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:28.151807 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-75dbeb57-2599-40a4-a631-247121e890ce admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Feb 15 02:55:28.152377 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:28.228316 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-45daba38-b1af-4a15-b4c5-c02e40ec5fb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:28.262372 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-45daba38-b1af-4a15-b4c5-c02e40ec5fb9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103190 Feb 15 02:55:28.263662 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 02:55:28.283887 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-26a0cfdf-abb0-480f-9453-f7ae4455db3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:28.324948 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-26a0cfdf-abb0-480f-9453-f7ae4455db3b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047549 Feb 15 02:55:28.335284 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Feb 15 02:55:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:55:31.041098 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-45daba38-b1af-4a15-b4c5-c02e40ec5fb9 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:31.042118 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-45daba38-b1af-4a15-b4c5-c02e40ec5fb9 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Feb 15 02:55:31.042530 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:31.109421 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-9bb8adf8-7cc7-4b76-bf24-824ecf4a6966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "ram": 2048}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:31.130380 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-9bb8adf8-7cc7-4b76-bf24-824ecf4a6966 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079994 Feb 15 02:55:31.130380 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:31.147671 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c23c5fa0-d979-44c3-b614-07182a80a4fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:31.175101 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-c23c5fa0-d979-44c3-b614-07182a80a4fa admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034366 Feb 15 02:55:31.176240 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Feb 15 02:55:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:55:33.675221 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-9bb8adf8-7cc7-4b76-bf24-824ecf4a6966 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:33.676715 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-9bb8adf8-7cc7-4b76-bf24-824ecf4a6966 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Feb 15 02:55:33.677123 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:33.749238 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-542ed4df-6f0e-4952-a5bc-dd8c74cc860e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "id": "d4", "ram": 4096}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:33.783411 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-542ed4df-6f0e-4952-a5bc-dd8c74cc860e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098392 Feb 15 02:55:33.784458 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:33.805062 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-3468c52c-ca00-43cd-a1bc-a860626d0455 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:33.846133 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-3468c52c-ca00-43cd-a1bc-a860626d0455 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047426 Feb 15 02:55:33.846962 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Feb 15 02:55:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 02:55:36.630248 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-542ed4df-6f0e-4952-a5bc-dd8c74cc860e admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:36.631482 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-542ed4df-6f0e-4952-a5bc-dd8c74cc860e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Feb 15 02:55:36.631965 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:36.698160 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-aef2ee86-e93c-44bb-8e75-f4c757dde2fb admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:36.723080 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-aef2ee86-e93c-44bb-8e75-f4c757dde2fb admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084212 Feb 15 02:55:36.725600 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Feb 15 02:55:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:55:39.049572 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-542ed4df-6f0e-4952-a5bc-dd8c74cc860e admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:39.050592 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-542ed4df-6f0e-4952-a5bc-dd8c74cc860e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Feb 15 02:55:39.051282 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:39.123624 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ee8521c6-f549-4cc4-8b6f-c1de47c7cb64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:39.146558 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ee8521c6-f549-4cc4-8b6f-c1de47c7cb64 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088528 Feb 15 02:55:39.147613 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 02:55:39.160235 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-add85403-9b52-45cb-811d-d00c857be429 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:39.187229 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-add85403-9b52-45cb-811d-d00c857be429 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030874 Feb 15 02:55:39.188191 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Feb 15 02:55:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 02:55:41.535218 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ee8521c6-f549-4cc4-8b6f-c1de47c7cb64 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:41.536681 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ee8521c6-f549-4cc4-8b6f-c1de47c7cb64 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002223 Feb 15 02:55:41.537187 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:41.602985 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-1ea8bed4-0fa6-4633-8ee1-d5fd5e7175af admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "name": "m1.small"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:41.622111 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-1ea8bed4-0fa6-4633-8ee1-d5fd5e7175af admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078653 Feb 15 02:55:41.622669 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 02:55:41.635815 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-311f93f8-f4c8-4713-88b6-bc01a16e7792 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:41.661650 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-311f93f8-f4c8-4713-88b6-bc01a16e7792 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030504 Feb 15 02:55:41.662553 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Feb 15 02:55:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:55:44.406410 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-1ea8bed4-0fa6-4633-8ee1-d5fd5e7175af admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:44.408163 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-1ea8bed4-0fa6-4633-8ee1-d5fd5e7175af admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002554 Feb 15 02:55:44.408591 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 02:55:44.486279 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ec3787cb-5982-481e-b2f7-784ee917d758 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "id": "3", "vcpus": 2, "ram": 4096}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:44.509692 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ec3787cb-5982-481e-b2f7-784ee917d758 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.093931 Feb 15 02:55:44.510307 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:44.524790 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-e3e54f9b-fd62-4a6f-b7ab-b00d1d5a5e96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:44.553959 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-e3e54f9b-fd62-4a6f-b7ab-b00d1d5a5e96 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033619 Feb 15 02:55:44.555115 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Feb 15 02:55:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:55:47.401810 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ec3787cb-5982-481e-b2f7-784ee917d758 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:47.402927 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ec3787cb-5982-481e-b2f7-784ee917d758 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Feb 15 02:55:47.403687 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:47.469104 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-705419a9-cdb5-498c-9b89-f5836e3a199c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:47.488268 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-705419a9-cdb5-498c-9b89-f5836e3a199c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077142 Feb 15 02:55:47.488671 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:47.504588 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-ff8aed5c-0da6-4820-ae17-3a6e0311456e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:47.538599 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-ff8aed5c-0da6-4820-ae17-3a6e0311456e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038429 Feb 15 02:55:47.539655 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Feb 15 02:55:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:55:49.918293 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-705419a9-cdb5-498c-9b89-f5836e3a199c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:55:49.919357 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-705419a9-cdb5-498c-9b89-f5836e3a199c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Feb 15 02:55:49.919766 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:55:49.980526 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-f34a890f-f7c1-4bed-bc04-222b0c1e8ee4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:49.999843 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-f34a890f-f7c1-4bed-bc04-222b0c1e8ee4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074024 Feb 15 02:55:50.000405 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Feb 15 02:55:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:55:50.013076 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-782e5ad2-62be-4a5d-9aa5-3afff7dce401 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:55:50.036620 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-782e5ad2-62be-4a5d-9aa5-3afff7dce401 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027133 Feb 15 02:55:50.037473 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Feb 15 02:55:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 02:56:17.375278 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-f34a890f-f7c1-4bed-bc04-222b0c1e8ee4 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:17.376280 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-f34a890f-f7c1-4bed-bc04-222b0c1e8ee4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Feb 15 02:56:17.376695 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:17.448460 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a6f6e392-4bb3-4355-a082-5bda7a352d1c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:17.465996 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a6f6e392-4bb3-4355-a082-5bda7a352d1c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.082344 Feb 15 02:56:17.466494 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Feb 15 02:56:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 02:56:18.894463 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-f34a890f-f7c1-4bed-bc04-222b0c1e8ee4 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:18.895489 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-f34a890f-f7c1-4bed-bc04-222b0c1e8ee4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Feb 15 02:56:18.895888 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:19.142356 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d671d6fc-a90e-4887-b326-056950652bdc admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:19.148535 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.wsgi [None req-d671d6fc-a90e-4887-b326-056950652bdc admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 15 02:56:19.149292 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d671d6fc-a90e-4887-b326-056950652bdc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 02:56:19.150128 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-d671d6fc-a90e-4887-b326-056950652bdc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065501 Feb 15 02:56:19.151056 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Feb 15 02:56:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 02:56:19.163478 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-6d13ea9d-3d2f-447b-b1c7-df7c4bf4a8dc admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:19.186522 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-6d13ea9d-3d2f-447b-b1c7-df7c4bf4a8dc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026581 Feb 15 02:56:19.187108 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Feb 15 02:56:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:56:19.197930 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-17793161-7d57-4505-b72c-a7ce47ae699a admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:19.222251 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-17793161-7d57-4505-b72c-a7ce47ae699a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028584 Feb 15 02:56:19.222844 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Feb 15 02:56:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:56:19.232520 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-fb0e40b2-8ad2-4920-9b2e-04028ab21e52 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:19.238254 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.wsgi [None req-fb0e40b2-8ad2-4920-9b2e-04028ab21e52 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 15 02:56:19.238939 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-fb0e40b2-8ad2-4920-9b2e-04028ab21e52 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 02:56:19.239680 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-fb0e40b2-8ad2-4920-9b2e-04028ab21e52 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010864 Feb 15 02:56:19.240222 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Feb 15 02:56:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 02:56:20.549306 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-17793161-7d57-4505-b72c-a7ce47ae699a admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:20.550310 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-17793161-7d57-4505-b72c-a7ce47ae699a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 15 02:56:20.550703 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:20.750203 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-f88126c6-2b75-4394-a202-fbb09b6203fe admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:20.755676 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.wsgi [None req-f88126c6-2b75-4394-a202-fbb09b6203fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 15 02:56:20.756244 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-f88126c6-2b75-4394-a202-fbb09b6203fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 02:56:20.757764 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-f88126c6-2b75-4394-a202-fbb09b6203fe admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064568 Feb 15 02:56:20.758462 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Feb 15 02:56:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 02:56:20.767830 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-e2d0cacf-fee0-4ec4-9c0a-0d0b9a407ef7 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:20.781659 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-e2d0cacf-fee0-4ec4-9c0a-0d0b9a407ef7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017392 Feb 15 02:56:20.782220 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Feb 15 02:56:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:56:20.792007 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-7367663e-be74-4bf3-ae8c-1d346f57af45 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:20.806371 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-7367663e-be74-4bf3-ae8c-1d346f57af45 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017859 Feb 15 02:56:20.806925 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Feb 15 02:56:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:56:20.816375 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-bb02dafd-cda6-431b-8c2f-26800a8294e6 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:20.822357 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.wsgi [None req-bb02dafd-cda6-431b-8c2f-26800a8294e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 15 02:56:20.822921 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-bb02dafd-cda6-431b-8c2f-26800a8294e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 02:56:20.823756 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-bb02dafd-cda6-431b-8c2f-26800a8294e6 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011009 Feb 15 02:56:20.824283 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Feb 15 02:56:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 15 02:56:22.127563 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-7367663e-be74-4bf3-ae8c-1d346f57af45 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:22.128571 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-7367663e-be74-4bf3-ae8c-1d346f57af45 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Feb 15 02:56:22.128969 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:22.324368 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-91ca40e7-822b-41b7-9603-b271e689d9d3 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:22.330266 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.wsgi [None req-91ca40e7-822b-41b7-9603-b271e689d9d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 15 02:56:22.330839 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-91ca40e7-822b-41b7-9603-b271e689d9d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 02:56:22.331679 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-91ca40e7-822b-41b7-9603-b271e689d9d3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059213 Feb 15 02:56:22.332210 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Feb 15 02:56:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 02:56:22.341751 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-d8e14306-b5e0-4067-b71d-f4ef0a84b48c admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:22.355662 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-d8e14306-b5e0-4067-b71d-f4ef0a84b48c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017382 Feb 15 02:56:22.356227 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Feb 15 02:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:56:22.370666 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:22.384571 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018883 Feb 15 02:56:22.385128 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Feb 15 02:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 02:56:22.394980 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-066aaef2-809c-4998-90a4-81dfd49c10e8 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:22.400665 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.wsgi [None req-066aaef2-809c-4998-90a4-81dfd49c10e8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 15 02:56:22.401231 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-066aaef2-809c-4998-90a4-81dfd49c10e8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 02:56:22.402027 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-066aaef2-809c-4998-90a4-81dfd49c10e8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010903 Feb 15 02:56:22.402550 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Feb 15 02:56:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 15 02:56:23.705075 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:23.706112 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Feb 15 02:56:23.706534 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:23.900082 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-276b7614-3c70-4b04-9154-873467ed07e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:56:23.918596 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-276b7614-3c70-4b04-9154-873467ed07e4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070916 Feb 15 02:56:23.919131 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Feb 15 02:56:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 02:56:25.228464 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:25.229490 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Feb 15 02:56:25.229897 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:25.423532 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1dd94619-0208-443f-adf9-c987abfd0824 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:56:25.441591 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1dd94619-0208-443f-adf9-c987abfd0824 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070208 Feb 15 02:56:25.442076 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Feb 15 02:56:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:56:26.746754 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:26.747798 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Feb 15 02:56:26.748199 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:26.937202 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-075dc833-822e-46b8-81ed-4829f98e1b8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:56:26.956185 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-075dc833-822e-46b8-81ed-4829f98e1b8e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070848 Feb 15 02:56:26.956650 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Feb 15 02:56:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:56:28.240670 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:28.242327 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Feb 15 02:56:28.242840 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 02:56:28.433328 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1c259009-254d-4a6a-ba80-aaf1a932fc6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 02:56:28.451780 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1c259009-254d-4a6a-ba80-aaf1a932fc6b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071743 Feb 15 02:56:28.452261 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Feb 15 02:56:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 02:56:29.729423 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:29.730429 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 15 02:56:29.730822 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 02:56:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:56:29.920419 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-8eb36dfb-6910-453e-b069-8ff0aaecb403 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:56:29.939982 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-8eb36dfb-6910-453e-b069-8ff0aaecb403 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071408 Feb 15 02:56:29.940458 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Tue Feb 15 02:56:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:57:16.114852 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:57:16.115890 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-a3be92bf-3a9d-4c5e-aa71-142b3f1e592c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Feb 15 02:57:16.116290 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Tue Feb 15 02:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 02:57:16.174954 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-d227da82-3947-4515-bebd-ffe9a2600dc7 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:57:16.194786 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-d227da82-3947-4515-bebd-ffe9a2600dc7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072144 Feb 15 02:57:16.195364 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Feb 15 02:57:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 02:57:16.218476 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-5b4709e3-c534-41c0-bc5d-ed79a66c5cf2 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:57:16.226655 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-5b4709e3-c534-41c0-bc5d-ed79a66c5cf2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011755 Feb 15 02:57:16.227231 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Tue Feb 15 02:57:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:57:16.239340 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-78971efa-bd0e-4150-b0b5-1b64e109e9c5 admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:57:16.247325 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-78971efa-bd0e-4150-b0b5-1b64e109e9c5 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011500 Feb 15 02:57:16.247853 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Tue Feb 15 02:57:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:57:16.260195 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-0ef1584a-6df1-4970-a83a-4e65ced87c4e admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:57:16.267926 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-0ef1584a-6df1-4970-a83a-4e65ced87c4e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011888 Feb 15 02:57:16.268463 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Tue Feb 15 02:57:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:57:16.280852 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:57:16.288613 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011311 Feb 15 02:57:16.289143 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Tue Feb 15 02:57:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 02:58:46.382722 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-167adfcb-8dd1-4b11-849e-09377ecb3e86 tempest-verify_tempest_config-1193041996 tempest-verify_tempest_config-1193041996-project] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 02:58:46.384930 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-167adfcb-8dd1-4b11-849e-09377ecb3e86 tempest-verify_tempest_config-1193041996 tempest-verify_tempest_config-1193041996-project] 10.222.0.24 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113226 Feb 15 02:58:46.385501 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 34/69] 10.222.0.24 () {58 vars in 1133 bytes} [Tue Feb 15 02:58:46 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:00:16.167393 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:16.168405 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Feb 15 03:00:16.168889 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 36/70] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 03:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:00:16.426523 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c22086b0-fced-43db-a399-8cb589405fdb admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:16.427750 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:00:16.427750 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Feb 15 03:00:16.429307 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c22086b0-fced-43db-a399-8cb589405fdb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:16.429758 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c22086b0-fced-43db-a399-8cb589405fdb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:16.430561 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c22086b0-fced-43db-a399-8cb589405fdb admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:16.430992 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c22086b0-fced-43db-a399-8cb589405fdb admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:16.470374 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-c22086b0-fced-43db-a399-8cb589405fdb admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159369 Feb 15 03:00:16.470959 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 35/71] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Feb 15 03:00:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:00:17.845726 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:17.846834 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Feb 15 03:00:17.847270 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 37/72] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 03:00:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:00:18.118632 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c530519c-1738-4ca7-83ac-ac33bb9fec95 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:18.119916 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:00:18.119916 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Feb 15 03:00:18.121649 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c530519c-1738-4ca7-83ac-ac33bb9fec95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:18.122933 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c530519c-1738-4ca7-83ac-ac33bb9fec95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:18.123825 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c530519c-1738-4ca7-83ac-ac33bb9fec95 admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:18.124261 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-c530519c-1738-4ca7-83ac-ac33bb9fec95 admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:18.148968 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-c530519c-1738-4ca7-83ac-ac33bb9fec95 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.096913 Feb 15 03:00:18.149540 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 36/73] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Feb 15 03:00:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:00:29.886063 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:29.887967 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002299 Feb 15 03:00:29.888367 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 38/74] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 03:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:00:30.082866 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-2f555f5d-835b-42cb-afb0-6205612cb750 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:30.084098 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:00:30.084098 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Feb 15 03:00:30.085635 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-2f555f5d-835b-42cb-afb0-6205612cb750 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:30.086071 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-2f555f5d-835b-42cb-afb0-6205612cb750 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:30.086899 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-2f555f5d-835b-42cb-afb0-6205612cb750 admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:30.087360 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-2f555f5d-835b-42cb-afb0-6205612cb750 admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:30.110170 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-2f555f5d-835b-42cb-afb0-6205612cb750 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080321 Feb 15 03:00:30.110642 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 37/75] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Feb 15 03:00:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:00:31.441598 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: DEBUG nova.api.openstack.wsgi [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] Calling method '>' {{(pid=101920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:31.442595 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: INFO nova.api.openstack.requestlog [None req-1acfdf6f-16fc-407c-b8dd-271775d47f4e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Feb 15 03:00:31.443000 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: [pid: 101920|app: 0|req: 39/76] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Feb 15 03:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:00:31.638625 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d25680b9-6cdf-4919-9762-f7b0446cf895 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:00:31.639843 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:00:31.639843 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Feb 15 03:00:31.641361 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-d25680b9-6cdf-4919-9762-f7b0446cf895 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:31.641808 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-d25680b9-6cdf-4919-9762-f7b0446cf895 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:31.642610 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-d25680b9-6cdf-4919-9762-f7b0446cf895 admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:00:31.643037 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-d25680b9-6cdf-4919-9762-f7b0446cf895 admin admin] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:00:31.664885 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-d25680b9-6cdf-4919-9762-f7b0446cf895 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079383 Feb 15 03:00:31.665448 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 38/77] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Feb 15 03:00:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:01:30.790499 dv-cinder-828085-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 15 03:01:30.791374 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: Tue Feb 15 03:01:30 2022 - graceful shutdown triggered... Feb 15 03:01:30.791875 dv-cinder-828085-9-iscsi devstack@n-api.service[101920]: Gracefully killing worker 2 (pid: 101920)... Feb 15 03:01:30.792241 dv-cinder-828085-9-iscsi devstack@n-api.service[101919]: Gracefully killing worker 1 (pid: 101919)... Feb 15 03:01:31.792534 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: worker 1 buried after 1 seconds Feb 15 03:01:31.792534 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: worker 2 buried after 1 seconds Feb 15 03:01:31.792534 dv-cinder-828085-9-iscsi devstack@n-api.service[101918]: goodbye to uWSGI. Feb 15 03:01:31.794126 dv-cinder-828085-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 15 03:01:31.794676 dv-cinder-828085-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 15 03:01:31.797570 dv-cinder-828085-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 15 03:01:31.807840 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 03:01:31 2022] *** Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: nodename: dv-cinder-828085-9-iscsi Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: machine: x86_64 Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: clock source: unix Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: pcre jit disabled Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: detected number of CPU cores: 4 Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: current working directory: / Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: detected binary path: /usr/bin/uwsgi-core Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: your processes number limit is 47680 Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: your memory page size is 4096 bytes Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: detected max file descriptor number: 2048 Feb 15 03:01:31.809916 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: lock engine: pthread robust mutexes Feb 15 03:01:31.810941 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: thunder lock: enabled Feb 15 03:01:31.810941 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 15 03:01:31.810941 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 03:01:31.857228 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: Python main interpreter initialized at 0x55ffd7d579c0 Feb 15 03:01:31.857228 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: python threads support enabled Feb 15 03:01:31.857228 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: your server socket listen backlog is limited to 100 connections Feb 15 03:01:31.857228 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: your mercy for graceful operations on workers is 90 seconds Feb 15 03:01:31.857630 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 03:01:31.857630 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: *** Operational MODE: preforking *** Feb 15 03:01:31.857871 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: *** uWSGI is running in multiple interpreter mode *** Feb 15 03:01:31.857871 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: spawned uWSGI master process (pid: 116482) Feb 15 03:01:31.858081 dv-cinder-828085-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 15 03:01:31.862287 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: spawned uWSGI worker 1 (pid: 116500, cores: 1) Feb 15 03:01:31.862287 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: spawned uWSGI worker 2 (pid: 116501, cores: 1) Feb 15 03:01:31.862287 dv-cinder-828085-9-iscsi devstack@n-api.service[116482]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 03:01:33.802758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 03:01:33.802758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: from cryptography.utils import int_from_bytes Feb 15 03:01:33.804081 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 03:01:33.804081 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: from cryptography.utils import int_from_bytes Feb 15 03:01:33.865184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 03:01:33.865184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: from cryptography.utils import int_from_bytes Feb 15 03:01:33.865880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 03:01:33.865880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: from cryptography.utils import int_from_bytes Feb 15 03:01:36.235826 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 03:01:36.236379 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 03:01:36.236589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 03:01:36.236958 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 03:01:36.237251 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 03:01:36.237610 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.237949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.238275 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.238600 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.238936 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.239275 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.239604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.239930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.240265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.240526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.241373 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.241748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828085-9-iscsi {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.242073 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.242386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.242700 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.243023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.243361 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.243690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.244000 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.244501 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.245224 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.245539 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.245866 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.246230 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.246528 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.246844 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.247194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.247512 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.248055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.248371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.248990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828085-9-iscsi {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.249322 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.249650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.249955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.250394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.250700 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.251027 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.251387 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.251691 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.252006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.252338 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.252662 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.252988 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.253311 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.253625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.253965 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.254247 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.254569 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.254882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.255213 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.255469 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.255789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.256117 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.256498 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.257421 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.257682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.258040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.258381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.258707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.259101 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.259370 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.259686 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.260001 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.260315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.260630 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.260943 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.261256 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.261578 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.261900 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.262228 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.262541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.262863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.263292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.263549 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.263863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.264207 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.264529 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.264843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.265165 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.265492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.265807 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.266138 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.266437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.266759 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.267102 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.267440 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.267697 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.268005 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.268318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.268640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.268955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.269268 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.269577 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.269883 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.270197 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.270515 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.270825 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.271137 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.271470 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.271785 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.272130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.272589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.272907 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.273215 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.273541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.273853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.274197 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.274477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.274790 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.275113 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.275453 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.275766 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.276096 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.276417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.276722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.277043 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.277355 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.277667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.277997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.278292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.278606 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.279393 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.279393 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.279566 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.279845 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.280157 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.280466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.280779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.281087 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.281395 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.281699 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.282022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.282349 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.283198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.283198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.283397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.283627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.283968 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.284278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.284624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.285107 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.285277 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.285609 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.285934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.286251 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.286574 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.286902 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.287239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.287560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.287914 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.288240 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.288659 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.288996 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.289320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.289650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.289973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.290290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.290617 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.290948 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.291300 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.291622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.291968 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.292316 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.292634 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.292961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.293291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.293609 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.293925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.294240 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.294566 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.294904 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.295239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.295567 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.295886 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.296212 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.296528 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.296852 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.297165 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.297503 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.297825 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.298144 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.298462 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.298783 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.299100 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.299454 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.299766 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.300076 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.300385 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.300693 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.301006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.301315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.301638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.301967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.302279 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.302615 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.302925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.303274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.304193 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.304562 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.304878 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.305200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.305522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.305837 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.306165 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.306486 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.306799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.307129 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.307470 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.307780 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.308100 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.308420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.308738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.309053 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.309386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.309702 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.310017 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.310357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.310691 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.311002 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.311353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.311684 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.312013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.312314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.312629 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.312941 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.313252 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.313559 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.313871 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.314189 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.314484 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.314793 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.315101 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.315433 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.315760 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.316076 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.316396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.316703 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.317023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.317359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.317664 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.318008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.318346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.318792 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.319087 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.320022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.320352 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.320669 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.320987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.321356 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.321625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.321952 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.322268 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.322593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.322910 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.323261 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.323581 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.324012 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.324198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.324517 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.324858 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.325334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.325658 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.326132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.326303 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.326633 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.326948 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.327360 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.327684 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.328002 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.328329 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.328651 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.328974 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.329288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.329616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.329937 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.330873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.330873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.330873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.331507 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.331507 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.331840 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.332157 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.332491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.332802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.333112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.333427 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.333737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.334044 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.334357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.334708 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.335028 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.335371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.335679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.335997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.336310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.336623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.336930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.337247 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.337572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.337885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.338208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.338532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.338838 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.339161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.339491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.339804 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.340113 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.340423 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.340731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.341078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.341393 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.341703 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.342020 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.342343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.342596 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 03:01:36.343064 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.343312 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 03:01:36.343445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.343445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.343711 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 03:01:36.343854 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.343991 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 03:01:36.344132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.344270 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 03:01:36.344398 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.344538 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.344704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.344843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.344987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.345126 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.345262 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.345397 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.345526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.345715 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.345955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.346088 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.346228 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.346366 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.346492 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.346631 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.346760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.346947 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.347102 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.347505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.347660 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.347869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.348009 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.348136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.348274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828085-9-iscsi {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.348510 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.348685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.348825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.349022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.349153 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.349346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.349483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.349666 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.349805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.349990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.350137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.350384 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.350569 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.350724 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.351019 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.351241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.351391 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.351539 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.351708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.351873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.352028 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.352168 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.352297 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.352434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.352563 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.352689 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.352879 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.353008 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.353232 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.353544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.353690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.353828 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.353996 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.354209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.354346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.354471 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.354586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.354713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828085-9-iscsi {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.354834 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.354974 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.355102 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.355296 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.355425 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.355553 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.355705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.355893 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.356033 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.356210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.356335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.356521 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.356666 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.356852 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.356985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.357166 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.357304 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.357475 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.357610 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.357861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.358019 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.358145 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.358267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.358410 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.358541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.358712 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.358846 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.359056 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.359264 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.359421 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.359555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.359741 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.359872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.360096 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.360247 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.361913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.362087 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.362251 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.362384 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.362522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.362662 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.362800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.362930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.363069 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.364080 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.364430 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.364593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.364732 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.364875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.365034 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.365175 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.365316 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.365447 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.365697 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.366350 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.366519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.366662 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.366811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.366955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.367094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.367245 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.367396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.367533 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.367675 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.367804 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.367954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.368082 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.368209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.368347 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.368488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.368622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.368761 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.368897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.369033 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.369172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.369308 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.369443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.369571 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.369714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.369840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.369984 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.370128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.370257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.370396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.370537 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.370683 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.370839 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.370968 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.371107 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.371426 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.371587 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.371737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.371895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.372034 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.372186 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.372319 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.372462 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.372616 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.372745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.372745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.373002 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.373132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.373263 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.373457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.373664 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.373794 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.373927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.374066 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.374215 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.374359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.374490 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.374618 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.374758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.374891 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.375034 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.375186 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.375327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.376662 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.376802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.376951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.377097 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.377241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.377384 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.377526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.377664 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.377811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.377952 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.378084 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.378222 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.378362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.378500 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.378652 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.378792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.378932 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.379074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.379259 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.379391 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.379610 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.379740 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.379889 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.380019 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.380159 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.380289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.380438 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.380568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.380701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.380832 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.380985 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.381133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.381263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.381434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.381604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.381752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.381897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.382053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.382201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.382825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.382963 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.383109 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.383264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.383411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.383562 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.383703 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.383852 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.383983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.384125 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.384255 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.384386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.384541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.384699 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.384913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.385045 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.385178 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.385317 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.385457 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.385599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.385726 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.385857 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.385963 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.386353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.386513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.386644 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.386985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.387204 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.387397 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.387579 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.387773 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.387949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.388118 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.388300 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.388476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.388656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.388840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.389050 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.389239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.389414 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.389599 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.389789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.389992 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.390167 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.390353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.390534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.390704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.390993 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.391302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.391480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.391667 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.391843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.392029 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.392222 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.392403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.392403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 03:01:36.392403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.392914 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.393092 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.393292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.393489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.393678 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.393857 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394168 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394452 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394598 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.394923 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395069 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395217 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395339 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395483 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395610 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395754 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.395902 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.396040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.396178 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.396306 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.396610 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.396754 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.396901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.397143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.398194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.399049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.399049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.399049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.399523 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.399523 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.399769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.400086 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.400511 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.400831 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.401143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.401562 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.401880 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.402195 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.402524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.402851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.410954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.410954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.410954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411365 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411445 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411660 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411879 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.411957 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412195 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412420 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412494 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412562 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.412644 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413221 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413295 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413363 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413430 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413530 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413742 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413893 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.413983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414303 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414385 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414464 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414603 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414753 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414897 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.414967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415042 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415122 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415308 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415391 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415470 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415562 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415562 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415718 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415796 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.415946 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416015 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416095 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416174 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416253 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416470 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416626 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416725 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.416950 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417030 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417114 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417186 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417428 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417511 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417582 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417658 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417736 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417806 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417881 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.417959 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418037 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418105 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418173 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418308 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418386 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418607 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418676 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418744 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.418826 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.419543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.419643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.419715 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.419797 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.419884 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.419956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.420045 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.420116 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.422793 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.422898 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.422987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423067 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423168 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423261 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423408 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423497 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423593 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423725 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423725 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.423938 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.424019 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.424099 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.424170 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.424245 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.424315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.424391 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426212 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426296 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426435 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426513 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426584 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426745 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426815 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426889 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.426961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427037 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427117 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427215 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427289 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427438 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427814 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427883 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.427960 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.428037 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.428108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.428176 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.428244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.428334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.429188 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.429332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431290 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431368 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431447 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431525 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431605 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431840 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431917 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.431987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432064 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432135 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432211 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432365 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432448 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432741 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.432956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.433049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.433145 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.433227 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.433311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.433467 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.433590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435211 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435315 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435701 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.435931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.436066 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.436141 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.436217 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.436287 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.436364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437255 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437383 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437508 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437635 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437877 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.437985 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.438107 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.438220 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.438220 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.438433 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.438513 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.439068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.439185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.439276 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.439350 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.439434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.440415 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.440519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.440602 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.440673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.440785 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.440909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441033 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441160 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.441911 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.442573 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.442685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.442768 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.442840 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.442909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.442977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.443046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.443123 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.443591 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.443696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.443770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.443845 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.444090 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.444292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.444505 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.444718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.444922 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.445195 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.445417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.445588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.445751 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.445904 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.446063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.446216 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.446382 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.446543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.446704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.446858 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.447020 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.447208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.447384 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.447546 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.447717 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.447879 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.448032 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.448185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.448525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.448699 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.448864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.449026 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.449179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.449342 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.449495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.449646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.449646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.450641 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.450798 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.450962 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.451117 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.451510 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.451705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.451871 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.451871 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.452178 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.452340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.452501 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.452661 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.452829 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.452982 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.453273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.453448 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.453603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.453755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.453907 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.454078 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.454252 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.454474 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.454645 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.454645 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.454938 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.455112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.455302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.455458 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.455609 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.455769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.455929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.456093 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.456246 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.456398 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.456556 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.456717 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.456878 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.457045 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.457215 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.457377 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.457530 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.457689 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.457855 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458166 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458327 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458487 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458641 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458807 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.458960 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.459111 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.459304 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.459460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.459619 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.459781 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.459952 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.460812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.460967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.461120 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.461273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.461437 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.461600 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.461762 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.461762 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.462083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.462246 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.462401 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.462554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.462713 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.462873 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.463034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.463269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.463430 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.463584 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.463745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.463905 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.464081 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.464244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.464404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.464565 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.464726 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.464878 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.465030 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.465192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.465353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.465514 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.465683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.465846 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466171 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466331 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466642 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466810 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.466963 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.467123 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.467308 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.467462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.467614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.467776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.467776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.468066 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.468235 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.468389 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.468389 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.468687 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.468849 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469002 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469153 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469792 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.469953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.470142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.470971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.471182 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.471357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.471511 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.471672 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.471833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.471997 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.472158 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.472158 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.472754 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.472912 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.473065 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.473244 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.473416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.473577 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.473730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.473896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.474058 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.474219 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.474371 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.474531 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.474694 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.474847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.475047 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.475750 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.476795 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.476973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.477153 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.477311 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.477465 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.477616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.477769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.477922 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478341 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478649 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478822 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478976 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478976 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.478976 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.479444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.479596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.479748 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.479919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.480091 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.480245 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.480944 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.481210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.481372 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.481372 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.481698 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.481879 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.482126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.482126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.482434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.482602 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.482765 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.482919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.483072 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.483292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.483475 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.483643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.483812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.483975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.484129 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.484294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.484456 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.484620 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.484774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.484934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.485087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.485239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.485407 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.485562 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.485725 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.485879 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.486033 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.486201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.486364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.486532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.486950 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.487111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.487301 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.487468 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.487624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.490202 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.490400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.492124 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.492422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.492606 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.492767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.492936 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.493108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.493319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.493478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.493653 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.493820 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.493976 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.494135 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.494303 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.494504 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.494668 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.494828 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.494992 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.495161 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.495335 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.495498 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.495654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.495806 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.495958 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.496123 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.496289 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.496467 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.496621 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.496773 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.496927 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.497080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.497241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.497404 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.497567 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.497720 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.497885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.498038 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.498207 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.498371 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.498533 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.498693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.498847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499006 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499229 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499229 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499528 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499834 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.499998 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.500165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.500165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.500475 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.500654 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.501798 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.502142 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.502379 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.502744 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.503071 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.503278 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.503439 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.503612 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.503780 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.503935 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.504109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.504264 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.504419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.504586 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.504740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.504901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.505056 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.505218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.505372 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.505541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.505701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.505854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.506007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.506177 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.506351 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.506561 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.506719 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.506880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.507035 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.507232 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.507402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.507566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.507734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.507888 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508041 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.508202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.509395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.510647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.512439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.513890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.515070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.516369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.517551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.517551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.517551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.517551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.518245 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.518399 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.518855 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.519206 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.519525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.519849 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.520189 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.520513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.520850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.521614 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.521804 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_db.sqlalchemy.engines [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.521970 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.521970 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.522785 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.522785 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.523321 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.523615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.523799 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.524100 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.524422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.524755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.525082 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.525488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.525848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.526074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.526406 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.526724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.527062 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.527423 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.527751 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.528086 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.528520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.528857 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.529184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.529524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.529864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.530183 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.530502 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.530832 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.531174 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.531531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.531966 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.532133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.532440 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.532790 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.533074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.533392 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.533711 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.534044 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.534362 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.534695 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.535024 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.535383 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.535720 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.536039 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.536375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.536698 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.537017 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.537334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.537652 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.538535 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.538895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.539303 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.539651 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.539997 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.540388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.540743 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.541085 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.541495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.541985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.542149 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.542382 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.542834 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.543015 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.543422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.543667 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.544442 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.544442 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.544909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.545233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.545557 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.545907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.546227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.546564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.546894 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.547238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.547563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.547884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.548243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.548563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.548910 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.549246 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.549583 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.549930 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.550257 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.550598 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.550932 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.551297 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.551825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.552170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.552507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.552834 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.553172 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.554191 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.554599 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.555052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.555526 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.556129 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.556478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.556814 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.557148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.557481 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.557815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.558148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.558478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.558809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.559138 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.559488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.559834 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.560170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.560509 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.560861 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.561194 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.561533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.561868 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.562204 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.562579 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.562912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.563254 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.563583 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.563913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.564244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.564579 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.564894 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.565220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.565541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.565869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.566193 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.566520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.566849 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.567213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.567565 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.567897 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.568225 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.568554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.568884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.569648 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.569982 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.570331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.570671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.571011 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.571370 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.571712 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.572056 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.572379 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.572698 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.573020 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.573349 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.573669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.574002 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.574329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.574652 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.574990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.575334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.575894 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.576257 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.576587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.576927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.577266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.577602 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.577921 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.578256 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.578574 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.578895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.579449 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.579637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.579872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.580192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.580517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.580839 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.581157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.581480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.581801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.582142 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.582462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.582781 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.583098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.583479 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.583768 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.584359 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.584833 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.585286 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.585692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.586046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.586260 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.586580 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.586907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.587252 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.587581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.587756 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.context [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f961b14e-12e5-47a3-bada-8b53b85b0202(cell1) {{(pid=116501) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 03:01:36.587916 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.588282 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.588601 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.588917 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.589251 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.589577 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.589913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.590238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.590563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.590923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.591569 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.592007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:01:36.592187 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.592482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.592816 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.593175 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.593530 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.593691 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:01:36.593858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.594157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.594415 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:01:36.594587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.594802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.595130 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.595516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.595819 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.596166 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.596393 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:01:36.596555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.596778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.597160 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.597746 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.598072 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.598450 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.599375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.599375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.599690 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.599858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.599858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.601076 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.601411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.601834 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.602128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.602548 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.602854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.603437 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.603797 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.604324 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.604760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.607804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.609326 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.609326 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.609326 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.609326 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.609913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.610073 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_db.sqlalchemy.engines [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.610233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.610233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.610549 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.610708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.611013 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.611385 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.611738 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.612137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.612522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.612814 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.613027 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_db.sqlalchemy.engines [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.613203 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.613485 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.613688 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.614929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.614929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.614929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.615524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.615524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.615927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.616294 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.616671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.617002 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.617335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.617673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.618144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.618322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.618637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.619039 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.619340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.619676 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.620005 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.620681 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.620681 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.621008 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.621292 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.621623 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.622008 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.622290 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.622611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.622946 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.623309 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.623646 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.624030 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.624342 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.624669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.625072 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.625361 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.625691 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.626019 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.626338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 03:01:36.626592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 03:01:36.650683 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_db.sqlalchemy.engines [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.717394 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.context [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f961b14e-12e5-47a3-bada-8b53b85b0202(cell1) {{(pid=116500) load_cells /opt/stack/nova/nova/context.py:464}} Feb 15 03:01:36.721601 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:01:36.723521 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:01:36.724357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:01:36.726534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:01:36.739668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_db.sqlalchemy.engines [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.745639 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_db.sqlalchemy.engines [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.781015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_db.sqlalchemy.engines [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:36.907243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_db.sqlalchemy.engines [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 03:01:37.115702 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: WARNING keystonemiddleware.auth_token [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 03:01:37.122588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: WARNING keystonemiddleware.auth_token [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 03:01:37.235305 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: WARNING keystonemiddleware.auth_token [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 03:01:37.242551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: WARNING keystonemiddleware.auth_token [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 03:01:37.468640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: WARNING keystonemiddleware.auth_token [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 03:01:37.474569 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: WARNING keystonemiddleware.auth_token [None req-66e5c8af-57c4-4b7b-9a13-f8569bb7737c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 03:01:37.481355 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ffd7d579c0 pid: 116501 (default app) Feb 15 03:01:37.581737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: WARNING keystonemiddleware.auth_token [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 15 03:01:37.587591 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: WARNING keystonemiddleware.auth_token [None req-74e11100-d2aa-4a31-9fcd-31e127012e57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 15 03:01:37.592998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ffd7d579c0 pid: 116500 (default app) Feb 15 03:02:15.664543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9fceac39-c83b-4f46-abcb-8065207c9a5c tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Action: 'create', calling method: .version_select at 0x7fe753746b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-268559000"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:16.414364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cb742ebc-e232-4083-af69-9630e68f9084 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Action: 'create', calling method: .version_select at 0x7fe753744ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719821941", "metadata": {"Type": "work"}}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:16.431474 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cb742ebc-e232-4083-af69-9630e68f9084 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:16.433358 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cb742ebc-e232-4083-af69-9630e68f9084 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.545500 Feb 15 03:02:16.436179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Feb 15 03:02:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1550 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 15 03:02:16.750569 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-480265561", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "7a5b4472-1482-406e-b9ba-ee756f2ad38f"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:17.262952 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] validate_networks() for [('7a5b4472-1482-406e-b9ba-ee756f2ad38f', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:02:17.788178 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9fceac39-c83b-4f46-abcb-8065207c9a5c tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.942827 Feb 15 03:02:17.789636 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 1/2] 10.222.0.24 () {60 vars in 1154 bytes} [Tue Feb 15 03:02:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3946 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 15 03:02:17.808617 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8025944f-f404-45ea-918d-a6c4dc41c0bc tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Action: 'create', calling method: .version_select at 0x7fe753697700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1414409225", "metadata": {"Type": "work"}}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:17.819046 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8025944f-f404-45ea-918d-a6c4dc41c0bc tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:17.819846 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8025944f-f404-45ea-918d-a6c4dc41c0bc tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026151 Feb 15 03:02:17.824734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Feb 15 03:02:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 03:02:17.835018 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5d51bbdf-174c-4ce2-a26c-3b755ec04ec3 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe753c6f700>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:17.940605 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5d51bbdf-174c-4ce2-a26c-3b755ec04ec3 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/e362c77d-708b-49b8-b29b-9cf99a1fa8b6" status: 200 len: 351 microversion: 2.1 time: 0.114136 Feb 15 03:02:17.948706 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 3/4] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:17 2022] GET /compute/v2.1/os-volumes/e362c77d-708b-49b8-b29b-9cf99a1fa8b6 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:17.949747 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-244e0c77-2af1-4f3d-a0b1-cb109c85e691 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe75362e0d0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:18.103479 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-244e0c77-2af1-4f3d-a0b1-cb109c85e691 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c" status: 200 len: 344 microversion: 2.1 time: 0.158876 Feb 15 03:02:18.108584 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 4/5] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:17 2022] GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:18.110099 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-016657e4-2a58-4c2a-843c-eb7384694218 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Action: 'create', calling method: .version_select at 0x7fe75362e9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1924546633", "metadata": {"Type": "work"}}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:18.111531 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-016657e4-2a58-4c2a-843c-eb7384694218 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:18.112437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-016657e4-2a58-4c2a-843c-eb7384694218 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006376 Feb 15 03:02:18.120305 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 5/6] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Feb 15 03:02:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 03:02:18.128833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3f12e8d0-ed11-47f4-a825-2ecebeacc8f5 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Calling method '.version_select at 0x7fe753c31430>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:18.191463 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-3f12e8d0-ed11-47f4-a825-2ecebeacc8f5 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] HTTP exception thrown: Volume tempest-invalid-1946967717 could not be found. Feb 15 03:02:18.192500 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3f12e8d0-ed11-47f4-a825-2ecebeacc8f5 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Returning 404 to user: Volume tempest-invalid-1946967717 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:18.193648 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3f12e8d0-ed11-47f4-a825-2ecebeacc8f5 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1946967717" status: 404 len: 99 microversion: 2.1 time: 0.072137 Feb 15 03:02:18.199474 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 6/7] 10.222.0.24 () {58 vars in 1217 bytes} [Tue Feb 15 03:02:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1946967717 => generated 99 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 15 03:02:18.206128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3dacdc81-74da-4d30-bf56-b6f5d6c6bae7 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005152 Feb 15 03:02:18.213733 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 7/8] 10.222.0.24 () {58 vars in 1139 bytes} [Tue Feb 15 03:02:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 15 03:02:18.226505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-df7d0278-d575-4ddc-a164-c139755add83 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010667 Feb 15 03:02:18.237861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 8/9] 10.222.0.24 () {58 vars in 1136 bytes} [Tue Feb 15 03:02:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 15 03:02:18.244336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c417ec11-ea4c-4b09-b821-69d161b7bb40 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Calling method '.version_select at 0x7fe75362e3a0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:18.299372 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-c417ec11-ea4c-4b09-b821-69d161b7bb40 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] HTTP exception thrown: Volume 28998181-1335-41e2-8805-ba1dfe048dcf could not be found. Feb 15 03:02:18.300275 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c417ec11-ea4c-4b09-b821-69d161b7bb40 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Returning 404 to user: Volume 28998181-1335-41e2-8805-ba1dfe048dcf could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:18.301376 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c417ec11-ea4c-4b09-b821-69d161b7bb40 tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/28998181-1335-41e2-8805-ba1dfe048dcf" status: 404 len: 109 microversion: 2.1 time: 0.061861 Feb 15 03:02:18.302297 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 9/10] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Feb 15 03:02:18 2022] DELETE /compute/v2.1/os-volumes/28998181-1335-41e2-8805-ba1dfe048dcf => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:02:18.311914 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6d873d38-7374-4bfa-909a-c5838a2d88da tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Calling method '.version_select at 0x7fe75362edc0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:18.368458 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-6d873d38-7374-4bfa-909a-c5838a2d88da tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] HTTP exception thrown: Volume 5b6132c3-23f8-4039-b2bd-adebf1a8dd97 could not be found. Feb 15 03:02:18.369303 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6d873d38-7374-4bfa-909a-c5838a2d88da tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] Returning 404 to user: Volume 5b6132c3-23f8-4039-b2bd-adebf1a8dd97 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:18.370647 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-6d873d38-7374-4bfa-909a-c5838a2d88da tempest-VolumesNegativeTest-1693036960 tempest-VolumesNegativeTest-1693036960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5b6132c3-23f8-4039-b2bd-adebf1a8dd97" status: 404 len: 109 microversion: 2.1 time: 0.062815 Feb 15 03:02:18.371529 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 10/11] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:18 2022] GET /compute/v2.1/os-volumes/5b6132c3-23f8-4039-b2bd-adebf1a8dd97 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 03:02:19.116404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-06aacbb1-52e2-4bc8-98c1-2c2d11cf7735 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe753608820>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:19.217899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-06aacbb1-52e2-4bc8-98c1-2c2d11cf7735 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c" status: 200 len: 345 microversion: 2.1 time: 0.105410 Feb 15 03:02:19.218817 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 11/12] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:19 2022] GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:19.231210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-39166202-6cee-4495-b48f-cdfa478d40d4 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Action: 'create', calling method: .version_select at 0x7fe75362edc0>, body: {"snapshot": {"volume_id": "7a3fd6f4-8ccb-48a9-95fe-ea721199664c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-793281278"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:19.433907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:02:19.433907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:02:19.433907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:02:19.433907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:02:19.433907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:02:19.472179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:19.473077 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:19.473915 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:19.474334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:19.521740 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Getting quotas for project 56d6a0518ac743a5977510bac8e9e8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:02:19.532801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Getting quotas for user 6297e603bae045c1870a54fe6c5c5593 and project 56d6a0518ac743a5977510bac8e9e8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:02:19.556433 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:02:19.569341 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:02:19.660423 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-39166202-6cee-4495-b48f-cdfa478d40d4 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.431700 Feb 15 03:02:19.667524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 12/13] 10.222.0.24 () {60 vars in 1161 bytes} [Tue Feb 15 03:02:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:19.673288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-076fd550-0bd7-4b6c-928f-073f26fb0db9 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe753697700>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:19.705516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-064d8640-d99f-4be8-a76a-710f8a0ad9e4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.266785 Feb 15 03:02:19.711507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 2/14] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:02:19.728598 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e6e9d1fc-8f29-419c-b5c1-52156a26b90e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:19.730988 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e6e9d1fc-8f29-419c-b5c1-52156a26b90e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:20.060900 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-076fd550-0bd7-4b6c-928f-073f26fb0db9 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 200 len: 286 microversion: 2.1 time: 0.392134 Feb 15 03:02:20.061851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 13/15] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:02:19 2022] GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:20.075951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-38da3ffc-9ba2-4f87-a36e-20bc59b5b869 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe75362f5e0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:20.154199 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-38da3ffc-9ba2-4f87-a36e-20bc59b5b869 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.083802 Feb 15 03:02:20.155836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 14/16] 10.222.0.24 () {58 vars in 1139 bytes} [Tue Feb 15 03:02:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:20.164406 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9cf56ae6-06ef-465c-81a7-8c0cd0089ba9 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe75362faf0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:20.185465 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e6e9d1fc-8f29-419c-b5c1-52156a26b90e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:20.230679 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e6e9d1fc-8f29-419c-b5c1-52156a26b90e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1214 microversion: 2.1 time: 0.516421 Feb 15 03:02:20.234900 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 3/17] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:19 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1214 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:20.275650 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dd79813f-94b5-4c68-aa47-ad06d277fc21 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe752d6d550>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:20.294464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9cf56ae6-06ef-465c-81a7-8c0cd0089ba9 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/a2a6270a-8145-46bc-b9ce-a4c3e6fa7a6c" status: 200 len: 351 microversion: 2.1 time: 0.137221 Feb 15 03:02:20.295032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 15/18] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:20 2022] GET /compute/v2.1/os-volumes/a2a6270a-8145-46bc-b9ce-a4c3e6fa7a6c => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:20.731579 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1556121636", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:20.912552 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dd79813f-94b5-4c68-aa47-ad06d277fc21 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 200 len: 286 microversion: 2.1 time: 0.675929 Feb 15 03:02:20.913270 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 4/19] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:02:20 2022] GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 286 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:21.145598 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] validate_networks() for [('6ed07e91-a9c7-4c29-a409-32e81c8614ad', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:02:21.249737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-62012b30-dde6-422f-9dd3-a312831bac0e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:21.250241 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-62012b30-dde6-422f-9dd3-a312831bac0e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:21.653590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-62012b30-dde6-422f-9dd3-a312831bac0e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:21.665684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-62012b30-dde6-422f-9dd3-a312831bac0e tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1214 microversion: 2.1 time: 0.418386 Feb 15 03:02:21.678321 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 5/20] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:21 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:21.933238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-729cdd70-669f-45ba-95cb-557bbdd42317 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe7524e31f0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:21.992773 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-729cdd70-669f-45ba-95cb-557bbdd42317 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 200 len: 286 microversion: 2.1 time: 0.065023 Feb 15 03:02:21.998953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 6/21] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:02:21 2022] GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:22.688553 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:22.689219 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:22.700033 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:22.700969 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:22.701272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:22.701714 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:22.971767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:02:22.974243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:02:22.975549 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:02:22.976439 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:02:22.977243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:02:23.030651 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:23.032869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:23.034128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:23.037313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:23.083225 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:23.102055 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9f59a8e4-9f6a-477e-b8bd-7de262ea170d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1210 microversion: 2.1 time: 0.421846 Feb 15 03:02:23.113874 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 7/22] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:22 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1210 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:23.126925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8fd1ef6c-bf95-4a33-b7cd-bf1443cbfa86 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe752467700>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:23.140464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Getting quotas for project 4535bb088a284793a0937f05a754a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:02:23.165075 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Getting quotas for user 6799561830b940349318816d80699079 and project 4535bb088a284793a0937f05a754a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:02:23.200266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8fd1ef6c-bf95-4a33-b7cd-bf1443cbfa86 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 200 len: 287 microversion: 2.1 time: 0.084566 Feb 15 03:02:23.201387 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 8/23] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:02:23 2022] GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:23.205572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:02:23.212872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-51e32855-d121-479c-afc4-63da6d3afea7 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe752408160>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:23.218641 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:02:23.334093 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-51e32855-d121-479c-afc4-63da6d3afea7 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 202 len: 0 microversion: 2.1 time: 0.124547 Feb 15 03:02:23.334826 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 9/24] 10.222.0.24 () {58 vars in 1253 bytes} [Tue Feb 15 03:02:23 2022] DELETE /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:02:23.349642 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-52d26a33-975d-463b-a5af-eb8b2b619ba1 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe752408f70>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:23.418191 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-52d26a33-975d-463b-a5af-eb8b2b619ba1 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 200 len: 286 microversion: 2.1 time: 0.077491 Feb 15 03:02:23.419466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 10/25] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:02:23 2022] GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:02:23.440552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-da1a8a36-18d8-4a49-a15b-d0f2cbc7832f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.098230 Feb 15 03:02:23.442818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 16/26] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:02:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 03:02:23.455389 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ea7129d2-1e27-464d-9e7a-efa6f359c4df tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:23.456051 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ea7129d2-1e27-464d-9e7a-efa6f359c4df tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:23.619476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ea7129d2-1e27-464d-9e7a-efa6f359c4df tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:23.648939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ea7129d2-1e27-464d-9e7a-efa6f359c4df tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1222 microversion: 2.1 time: 0.194731 Feb 15 03:02:23.662750 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 11/27] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:23 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:23.678534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-514aed95-29f4-4419-9ada-73f1b3ceefc7 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe753532160>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:23.881236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-514aed95-29f4-4419-9ada-73f1b3ceefc7 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b895af76-34a1-4c2a-b453-83bda83ce27b" status: 200 len: 350 microversion: 2.1 time: 0.210432 Feb 15 03:02:23.889924 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 17/28] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:23 2022] GET /compute/v2.1/os-volumes/b895af76-34a1-4c2a-b453-83bda83ce27b => generated 350 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:23.893537 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d75b62b1-e692-425b-8dfe-8c22029fc1ad tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe752d6dd30>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:24.057638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1846933811", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:24.189340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d75b62b1-e692-425b-8dfe-8c22029fc1ad tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.299832 Feb 15 03:02:24.191358 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 12/29] 10.222.0.24 () {58 vars in 1133 bytes} [Tue Feb 15 03:02:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:24.197210 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:24.199181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:24.235847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] validate_networks() for [('6ed07e91-a9c7-4c29-a409-32e81c8614ad', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:02:24.240933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:24.242108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:24.248971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:24.249491 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:24.758957 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:24.769436 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f1079f66-499f-436c-ac78-bcd388737990 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1284 microversion: 2.1 time: 0.574719 Feb 15 03:02:24.783307 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 13/30] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:24 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1284 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:24.789816 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b9090cd9-9970-4c4c-9150-e3c589931c57 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe752462c10>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.062847 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b9090cd9-9970-4c4c-9150-e3c589931c57 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.278180 Feb 15 03:02:25.063536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 14/31] 10.222.0.24 () {58 vars in 1148 bytes} [Tue Feb 15 03:02:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:25.080192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-00d96c0f-be64-4af3-abf1-988e88b7b511 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe75242fdc0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.130745 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-00d96c0f-be64-4af3-abf1-988e88b7b511 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] HTTP exception thrown: Snapshot 46e48161-512f-43cb-b70c-043d0a1a01d3 could not be found. Feb 15 03:02:25.131385 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-00d96c0f-be64-4af3-abf1-988e88b7b511 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Returning 404 to user: Snapshot 46e48161-512f-43cb-b70c-043d0a1a01d3 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:25.132275 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-00d96c0f-be64-4af3-abf1-988e88b7b511 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3" status: 404 len: 111 microversion: 2.1 time: 0.058110 Feb 15 03:02:25.132770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 15/32] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:02:25 2022] GET /compute/v2.1/os-snapshots/46e48161-512f-43cb-b70c-043d0a1a01d3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:02:25.137157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6299fa91-6fc1-4446-8e14-aed14c78e221 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe75242f160>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.310181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6299fa91-6fc1-4446-8e14-aed14c78e221 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.176347 Feb 15 03:02:25.314076 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 16/33] 10.222.0.24 () {58 vars in 1133 bytes} [Tue Feb 15 03:02:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:25.327135 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8edf3dd7-3395-4104-953c-73e7c838465f tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe752d6de50>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.480976 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8edf3dd7-3395-4104-953c-73e7c838465f tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c" status: 202 len: 0 microversion: 2.1 time: 0.157413 Feb 15 03:02:25.481604 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 17/34] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Feb 15 03:02:25 2022] DELETE /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:02:25.486491 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-45a7734a-71f9-4fdb-ad31-dc0f950fd1d4 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe7524e3d30>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.701836 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-45a7734a-71f9-4fdb-ad31-dc0f950fd1d4 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.219023 Feb 15 03:02:25.702737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 18/35] 10.222.0.24 () {58 vars in 1166 bytes} [Tue Feb 15 03:02:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:25.718135 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e6045fd7-a682-4037-85e4-0d45c4f1d4d5 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe7536a6550>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.789050 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-e6045fd7-a682-4037-85e4-0d45c4f1d4d5 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] HTTP exception thrown: Volume 7a3fd6f4-8ccb-48a9-95fe-ea721199664c could not be found. Feb 15 03:02:25.789862 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e6045fd7-a682-4037-85e4-0d45c4f1d4d5 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Returning 404 to user: Volume 7a3fd6f4-8ccb-48a9-95fe-ea721199664c could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:25.790873 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e6045fd7-a682-4037-85e4-0d45c4f1d4d5 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c" status: 404 len: 109 microversion: 2.1 time: 0.077082 Feb 15 03:02:25.791884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 19/36] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:25 2022] GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:02:25.799851 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3f468e6d-ef63-43fc-976b-12d768eaa769 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe75242fc10>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:25.849100 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:02:25.849594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:02:25.850150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:02:25.850667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:02:25.851221 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:02:25.872700 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:25.873882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:25.875021 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:25.875704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:25.969602 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Getting quotas for project 4535bb088a284793a0937f05a754a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:02:26.001688 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Getting quotas for user 6799561830b940349318816d80699079 and project 4535bb088a284793a0937f05a754a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:02:26.051083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:02:26.053836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:02:26.185170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3f468e6d-ef63-43fc-976b-12d768eaa769 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.392045 Feb 15 03:02:26.195045 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 20/37] 10.222.0.24 () {58 vars in 1169 bytes} [Tue Feb 15 03:02:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:26.200767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:26.201854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:26.230532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-479fdbc7-7ea2-41cd-aeb4-d2f2215efa06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.178265 Feb 15 03:02:26.239014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:26.239754 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:26.240594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:26.245609 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 18/38] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:02:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:02:26.248243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:26.250440 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-134bd66a-0f66-4216-a351-a9a6789350fe tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe752cc2670>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:26.321259 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-134bd66a-0f66-4216-a351-a9a6789350fe tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] HTTP exception thrown: Volume 7a3fd6f4-8ccb-48a9-95fe-ea721199664c could not be found. Feb 15 03:02:26.321953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-134bd66a-0f66-4216-a351-a9a6789350fe tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Returning 404 to user: Volume 7a3fd6f4-8ccb-48a9-95fe-ea721199664c could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:26.322856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-134bd66a-0f66-4216-a351-a9a6789350fe tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c" status: 404 len: 109 microversion: 2.1 time: 0.076172 Feb 15 03:02:26.328354 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 19/39] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Feb 15 03:02:26 2022] DELETE /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:02:26.344359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-138efab0-4e9e-4524-b4e0-e3ae9e4ac65c tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe75362fe50>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:26.580884 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-138efab0-4e9e-4524-b4e0-e3ae9e4ac65c tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.250414 Feb 15 03:02:26.582326 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 20/40] 10.222.0.24 () {58 vars in 1154 bytes} [Tue Feb 15 03:02:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:26.587876 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cb7d6007-fcd0-4938-8575-4d63b51a4eb9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:26.588884 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cb7d6007-fcd0-4938-8575-4d63b51a4eb9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:26.724310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:26.752874 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-75ce6f2c-653a-45e6-9c4b-bdc198142800 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1272 microversion: 2.1 time: 0.555638 Feb 15 03:02:26.776733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 21/41] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:26 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1272 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:26.801055 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-940b1baf-d9d4-459d-9f85-db10809ba619 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Calling method '.version_select at 0x7fe7524624c0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:26.884928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-940b1baf-d9d4-459d-9f85-db10809ba619 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] HTTP exception thrown: Volume 7a3fd6f4-8ccb-48a9-95fe-ea721199664c could not be found. Feb 15 03:02:26.885074 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cb7d6007-fcd0-4938-8575-4d63b51a4eb9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:26.886580 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-940b1baf-d9d4-459d-9f85-db10809ba619 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] Returning 404 to user: Volume 7a3fd6f4-8ccb-48a9-95fe-ea721199664c could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:02:26.887814 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-940b1baf-d9d4-459d-9f85-db10809ba619 tempest-VolumesSnapshotsTestJSON-161337772 tempest-VolumesSnapshotsTestJSON-161337772-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c" status: 404 len: 109 microversion: 2.1 time: 0.109738 Feb 15 03:02:26.888713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 22/42] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:02:26 2022] GET /compute/v2.1/os-volumes/7a3fd6f4-8ccb-48a9-95fe-ea721199664c => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:02:26.896489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4c0957ee-b0c9-4cc0-a3f1-d70698230d8e tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe7523c9040>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:26.952889 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cb7d6007-fcd0-4938-8575-4d63b51a4eb9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1222 microversion: 2.1 time: 0.365247 Feb 15 03:02:26.959095 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 21/43] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:26 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1222 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:27.138000 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4c0957ee-b0c9-4cc0-a3f1-d70698230d8e tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.247361 Feb 15 03:02:27.139567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 23/44] 10.222.0.24 () {58 vars in 1187 bytes} [Tue Feb 15 03:02:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:27.153683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-03d49159-bbd3-4998-a35a-ac1bf7c34356 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] Calling method '.version_select at 0x7fe752cc50d0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:27.735832 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-03d49159-bbd3-4998-a35a-ac1bf7c34356 tempest-VolumesTestJSON-1843932696 tempest-VolumesTestJSON-1843932696-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.586403 Feb 15 03:02:27.736398 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 22/45] 10.222.0.24 () {58 vars in 1154 bytes} [Tue Feb 15 03:02:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:27.773769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:27.775253 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:27.820695 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:27.827770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:27.835793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:27.841864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:27.977247 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:27.977926 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:28.035646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:28.036085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:28.058022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:28.064445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:28.569482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:28.616244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-848c606e-0b98-46a0-bce0-d49e8e9c1c86 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.841847 Feb 15 03:02:28.623272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 24/46] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:27 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:28.917899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:28.966890 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f263c30c-2ed5-4438-855f-70d9e1fae84a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1218 microversion: 2.1 time: 0.994720 Feb 15 03:02:28.984283 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 23/47] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:27 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1218 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:29.660356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:29.684080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:29.702109 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:29.703590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:29.709912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:29.713080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:30.001374 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:30.002844 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:30.024809 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:30.032101 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:30.039320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:30.040011 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:30.657532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:30.693448 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e27f3bb9-5f26-49b5-bf50-b609f92301cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1280 microversion: 2.1 time: 0.694812 Feb 15 03:02:30.698078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 24/48] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:29 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1280 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:31.722816 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:31.744345 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:31.805287 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:31.809590 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:31.817057 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:31.817888 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:32.694706 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:32.707025 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ff9268f1-e548-423b-aa85-214c71e5dc85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1280 microversion: 2.1 time: 0.998357 Feb 15 03:02:32.723378 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 25/49] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:31 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1280 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:33.044043 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:33.058276 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6689eff8-698e-449a-95e1-4332b4c5c890 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 3.406794 Feb 15 03:02:33.061192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 25/50] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:29 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 3413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:33.745926 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:33.747585 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:33.776047 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:33.780269 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:33.807756 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:33.808656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:34.081023 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:34.084268 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:34.116093 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:34.116564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:34.122897 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:34.124721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:34.440429 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:34.471407 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0938b9e2-e0ba-4827-815a-ea211b8364dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1280 microversion: 2.1 time: 0.734927 Feb 15 03:02:34.476484 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 26/51] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:33 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1280 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:35.494307 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:35.495523 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:35.515416 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:35.516200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:35.517674 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:35.518456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:35.923202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:35.952113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-103f7c99-9e33-4492-b9ee-a7b5af1ecf19 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 1.875725 Feb 15 03:02:35.955186 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 26/52] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:34 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:36.282141 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-8ebf8dd0-dbe9-44c2-b69a-d25fdbb49e19 req-def689d3-1e44-475a-88ad-928edfcbdcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0499b0-e6f2-4496-9be3-ab51a3132354", "tag": "fdb2ff78-1b2a-416b-929c-83b03b4627aa"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:36.285767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:02:36.285767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:02:36.307640 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-8ebf8dd0-dbe9-44c2-b69a-d25fdbb49e19 req-def689d3-1e44-475a-88ad-928edfcbdcba service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:36.308089 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-8ebf8dd0-dbe9-44c2-b69a-d25fdbb49e19 req-def689d3-1e44-475a-88ad-928edfcbdcba service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:36.397908 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-8ebf8dd0-dbe9-44c2-b69a-d25fdbb49e19 req-def689d3-1e44-475a-88ad-928edfcbdcba service nova] Creating event network-changed:fdb2ff78-1b2a-416b-929c-83b03b4627aa for instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 on hv-cinder-82808 Feb 15 03:02:36.405128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-8ebf8dd0-dbe9-44c2-b69a-d25fdbb49e19 req-def689d3-1e44-475a-88ad-928edfcbdcba service nova] Acquired lock "compute-rpcapi-router" {{(pid=116500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 15 03:02:36.411141 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:36.412387 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:36.414094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:36.417881 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:36.453810 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.compute.rpcapi [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 15 03:02:36.463589 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=116500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 15 03:02:36.563450 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-abafc5f4-6647-4d35-990f-e5b01567d0c6 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602847 Feb 15 03:02:36.567314 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 27/53] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:36.986628 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:37.001741 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:37.035575 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:37.036567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:37.038028 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:37.038816 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:38.123119 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:38.195730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-26217c93-89e2-4bad-9412-aa0a0dd9ced9 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 1.201787 Feb 15 03:02:38.197576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 28/54] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:36 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:38.350808 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:38.385518 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c58edd41-33ea-4a41-b2d6-cf5d662b4b64 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 2.898055 Feb 15 03:02:38.392282 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 27/55] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:35 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 2906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:39.226249 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:39.226759 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:39.243685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:39.244266 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:39.245251 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:39.245714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:40.042993 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-be1cb83d-52d4-4c0b-8bbe-c50babc0ca50 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'create', calling method: .version_select at 0x7fe7523c2b80>, body: {"keypair": {"name": "tempest-keypair-946027531"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:40.155569 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-be1cb83d-52d4-4c0b-8bbe-c50babc0ca50 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:02:40.175327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-be1cb83d-52d4-4c0b-8bbe-c50babc0ca50 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for user 7df8d655a1264611a45016ecc787871e and project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:02:40.458480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:40.493951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b0afccf3-eb0c-417a-a1e6-b47d87c6b1c6 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 1.271526 Feb 15 03:02:40.514149 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 28/56] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:39 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:40.539292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:40.544201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:40.563042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:40.564904 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:40.574079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:40.574543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:41.305024 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-be1cb83d-52d4-4c0b-8bbe-c50babc0ca50 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:02:41.335376 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-be1cb83d-52d4-4c0b-8bbe-c50babc0ca50 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for user 7df8d655a1264611a45016ecc787871e and project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:02:41.437564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-be1cb83d-52d4-4c0b-8bbe-c50babc0ca50 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.420348 Feb 15 03:02:41.442447 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 29/57] 10.222.0.24 () {62 vars in 1198 bytes} [Tue Feb 15 03:02:39 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2427 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 15 03:02:41.604210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:41.615506 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-68546407-ae2a-4b59-b688-6c51d49dee79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 1.099876 Feb 15 03:02:41.635595 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 29/58] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:40 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:41.650248 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-98f4f37c-34b3-4147-ad80-dc49e0531ebd req-b2fb48a0-cfae-4ff7-81a5-c9ac667a31a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afb1287-b39f-4fd6-8b4a-c03103fcae40", "tag": "fcb04533-33a8-4b4f-a640-9248b6f38139"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:41.660850 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:02:41.660850 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:02:41.701029 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-98f4f37c-34b3-4147-ad80-dc49e0531ebd req-b2fb48a0-cfae-4ff7-81a5-c9ac667a31a8 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:41.710509 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-98f4f37c-34b3-4147-ad80-dc49e0531ebd req-b2fb48a0-cfae-4ff7-81a5-c9ac667a31a8 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:41.801743 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-98f4f37c-34b3-4147-ad80-dc49e0531ebd req-b2fb48a0-cfae-4ff7-81a5-c9ac667a31a8 service nova] Creating event network-changed:fcb04533-33a8-4b4f-a640-9248b6f38139 for instance 2afb1287-b39f-4fd6-8b4a-c03103fcae40 on hv-cinder-82808 Feb 15 03:02:41.817614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-98f4f37c-34b3-4147-ad80-dc49e0531ebd req-b2fb48a0-cfae-4ff7-81a5-c9ac667a31a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 15 03:02:41.823369 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:41.824003 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:41.832456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:41.833286 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:41.868680 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.compute.rpcapi [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 15 03:02:41.873628 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] Releasing lock "compute-rpcapi-router" {{(pid=116501) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 15 03:02:41.922617 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d698523b-34d8-4716-a4b6-f4edf79252fd None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283402 Feb 15 03:02:41.928823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 30/59] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:41.934694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:41.944655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:41.971906 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:41.975738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:41.978382 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:41.998792 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:42.127601 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-61682c5e-34dd-4e8c-9164-ab0fedebcfa1 req-2af08e76-42fb-48dd-aa96-b5b9df84164f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c947da6f-4d8e-46ce-8eba-63c9f3093204", "tag": "5276e6ba-9658-4499-ac62-9419dd84fc02"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:42.133046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:02:42.133046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:02:42.170243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-61682c5e-34dd-4e8c-9164-ab0fedebcfa1 req-2af08e76-42fb-48dd-aa96-b5b9df84164f service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:42.171075 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-61682c5e-34dd-4e8c-9164-ab0fedebcfa1 req-2af08e76-42fb-48dd-aa96-b5b9df84164f service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:42.258635 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-61682c5e-34dd-4e8c-9164-ab0fedebcfa1 req-2af08e76-42fb-48dd-aa96-b5b9df84164f service nova] Creating event network-changed:5276e6ba-9658-4499-ac62-9419dd84fc02 for instance c947da6f-4d8e-46ce-8eba-63c9f3093204 on hv-cinder-82808 Feb 15 03:02:42.286747 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-61682c5e-34dd-4e8c-9164-ab0fedebcfa1 req-2af08e76-42fb-48dd-aa96-b5b9df84164f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.835288 Feb 15 03:02:42.292501 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 30/60] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:42.513882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:42.523719 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8f84283e-0ece-419f-b014-6137bca101f0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.593028 Feb 15 03:02:42.531888 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 31/61] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:41 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:42.672157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:42.673545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:42.713330 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:42.715026 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:42.722571 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:42.732423 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:43.383828 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:43.425294 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9aa70ff1-177a-4bff-8429-bce35cba3ca5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.761484 Feb 15 03:02:43.447508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 31/62] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:42 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:43.551334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:43.552106 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:43.566657 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:43.569733 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:43.570784 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:43.574802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:44.470650 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:44.475411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:44.521635 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:44.523744 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:44.532769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:44.533611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:44.884782 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:44.897648 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e3546d3e-4541-4e30-8ec7-f5ecf8eb837f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 1.351884 Feb 15 03:02:44.910220 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 32/63] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:43 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:45.310618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:45.333207 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-57a0a6e4-47a2-4774-a618-b734b901a4b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.877613 Feb 15 03:02:45.336973 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 32/64] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:44 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:45.916187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:45.917022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:45.939061 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:45.939575 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:45.940972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:45.951942 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:46.354330 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:46.355133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:46.367636 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:46.379948 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:46.381216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:46.384185 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:46.544028 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:46.554255 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-efd6d19a-e544-4bf6-8856-65086aec7254 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.642031 Feb 15 03:02:46.559864 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 33/65] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:45 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:47.040110 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:47.069825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-523bea7d-21cf-47db-ae7b-ec42900f2ba7 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.717860 Feb 15 03:02:47.072409 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 33/66] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:46 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:47.581931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:47.588524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:47.618278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:47.620003 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:47.629973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:47.631235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:48.102279 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:48.104728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:48.141040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:48.146162 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:48.147863 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:48.150556 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:48.293124 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:48.317342 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-55286cd1-3731-4ed1-a713-f3049aa4ffb1 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.740410 Feb 15 03:02:48.324674 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 34/67] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:47 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:48.829949 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:48.848643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6c10a4ac-aba1-4b7c-8a1b-d8f9ae2c2dd2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.752987 Feb 15 03:02:48.850694 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 34/68] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:48 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:49.113362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-522040377", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c1a999e-ee82-4c20-9c13-04652372776f"}], "security_groups": [{"name": "tempest-securitygroup--595936655"}], "key_name": "tempest-keypair-946027531", "user_data": "}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:49.349269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:49.351745 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:49.385763 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:49.387973 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:49.393388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:49.396445 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:49.429559 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] validate_networks() for [('4c1a999e-ee82-4c20-9c13-04652372776f', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:02:50.006986 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:50.031458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d82ad856-af17-4714-890c-585b9104d277 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.688077 Feb 15 03:02:50.035391 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 35/69] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:49 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:50.058721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:50.060294 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:50.078788 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:50.080192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:50.082319 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:50.084079 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:50.422197 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:50.454633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-91abd368-4aa7-49fe-91a4-ebedc3a873e8 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.413808 Feb 15 03:02:50.456202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 36/70] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:50 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:50.534851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:02:50.537016 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:02:50.538200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:02:50.539215 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:02:50.540196 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:02:50.555616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:50.556363 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:50.557184 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:50.557771 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:50.577953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:02:50.583952 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for user 7df8d655a1264611a45016ecc787871e and project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:02:50.600737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:02:50.603286 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:02:50.665686 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8fc46d6c-304a-444a-bc75-33498e7279fb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.560247 Feb 15 03:02:50.666581 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 35/71] 10.222.0.24 () {62 vars in 1187 bytes} [Tue Feb 15 03:02:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 15 03:02:50.684770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-13b6f636-8c2f-41b2-a777-e7e8522701cc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:50.686182 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-13b6f636-8c2f-41b2-a777-e7e8522701cc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:50.833745 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-13b6f636-8c2f-41b2-a777-e7e8522701cc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:50.849358 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-13b6f636-8c2f-41b2-a777-e7e8522701cc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:50.852477 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-13b6f636-8c2f-41b2-a777-e7e8522701cc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:50.855606 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-13b6f636-8c2f-41b2-a777-e7e8522701cc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1280 microversion: 2.20 time: 0.178370 Feb 15 03:02:50.864443 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:02:50 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:02:51.061740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:51.063770 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:51.086117 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:51.086923 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:51.092925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:51.094078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:51.466096 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:51.480751 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:51.481583 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:51.487366 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0cb804c2-0ee0-446b-aeaf-2dcdb512566b tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.431998 Feb 15 03:02:51.489349 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 36/73] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:51 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:51.510520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:51.513828 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:51.520989 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:51.522627 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:51.893276 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:51.896654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:51.915235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:51.915698 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:51.921194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:51.923402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:51.978485 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:52.001479 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-bf231e2f-2f0e-4f6c-a8af-26ec20c2f5fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.525432 Feb 15 03:02:52.003137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 38/74] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:51 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:52.118044 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:52.199552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:52.204204 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:52.208625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3d6c27a0-becb-4ef5-85ba-58d6ba336717 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1284 microversion: 2.20 time: 0.325355 Feb 15 03:02:52.223187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 37/75] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:02:51 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1284 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:02:52.517087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:52.518789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:52.539508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:52.540303 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:52.541738 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:52.542429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:52.922513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:52.939070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c59fe168-ed07-471b-b16a-2d0057a785c0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.428365 Feb 15 03:02:52.942018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 39/76] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:52 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:53.027219 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:53.030650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:53.050497 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.055294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:53.059548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.060238 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:53.297061 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:53.307519 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c886ef4e-8a72-4b0f-9273-ef9652a0ed35 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.289122 Feb 15 03:02:53.308820 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 38/77] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:53 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:53.313967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:53.315174 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:53.333431 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.334203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:53.335799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.336567 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:53.439463 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:53.451078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:53.453941 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:53.456646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e3f3d2e5-a83d-452a-bda7-25108acb5d49 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1332 microversion: 2.20 time: 0.145384 Feb 15 03:02:53.457910 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 39/78] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:02:53 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:02:53.669798 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-de7c7cf0-c4e8-4fc6-91cd-7206ab437ae6 req-65bdd081-c76a-4792-a8c5-eca82c348213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0499b0-e6f2-4496-9be3-ab51a3132354", "name": "network-vif-plugged", "status": "completed", "tag": "fdb2ff78-1b2a-416b-929c-83b03b4627aa"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:53.673274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:02:53.673274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:02:53.716862 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-de7c7cf0-c4e8-4fc6-91cd-7206ab437ae6 req-65bdd081-c76a-4792-a8c5-eca82c348213 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.735554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-de7c7cf0-c4e8-4fc6-91cd-7206ab437ae6 req-65bdd081-c76a-4792-a8c5-eca82c348213 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:53.791827 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-de7c7cf0-c4e8-4fc6-91cd-7206ab437ae6 req-65bdd081-c76a-4792-a8c5-eca82c348213 service nova] Creating event network-vif-plugged:fdb2ff78-1b2a-416b-929c-83b03b4627aa for instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 on hv-cinder-82808 Feb 15 03:02:53.815229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-de7c7cf0-c4e8-4fc6-91cd-7206ab437ae6 req-65bdd081-c76a-4792-a8c5-eca82c348213 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.591510 Feb 15 03:02:53.838191 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 40/79] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:53.966645 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:53.967420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:53.991818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.992368 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:53.993249 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:53.993747 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:54.335299 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:54.336015 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:54.356400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:54.356889 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:54.361025 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:54.361995 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:54.756293 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:54.764516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-67866d86-22b7-4e99-a1af-3ee645b45919 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.434125 Feb 15 03:02:54.770915 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 41/80] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:54 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:54.785083 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:54.786568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:54.796205 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:54.797008 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:54.798851 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:54.800198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:54.912146 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:54.942716 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c3ecc3f1-2a79-468f-989b-1e88aab2a595 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 0.979360 Feb 15 03:02:54.951265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 40/81] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:53 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:54.975113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:55.019239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:55.029985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:55.038620 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d5663cd4-c0a9-487b-acca-c0a39895a412 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1338 microversion: 2.20 time: 0.259851 Feb 15 03:02:55.042935 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 42/82] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:02:54 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1338 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:02:55.793929 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:55.794673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:55.818937 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:55.821780 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:55.822736 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:55.823213 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:55.878605 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-b42bb278-aee7-4649-97ce-a42f813330b0 req-0d052860-f587-4c5d-b46a-15fcbc25e6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c947da6f-4d8e-46ce-8eba-63c9f3093204", "name": "network-vif-plugged", "status": "completed", "tag": "5276e6ba-9658-4499-ac62-9419dd84fc02"}, {"server_uuid": "2afb1287-b39f-4fd6-8b4a-c03103fcae40", "name": "network-vif-plugged", "status": "completed", "tag": "fcb04533-33a8-4b4f-a640-9248b6f38139"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:55.880592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:02:55.880592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:02:55.910055 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b42bb278-aee7-4649-97ce-a42f813330b0 req-0d052860-f587-4c5d-b46a-15fcbc25e6d3 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:55.910507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b42bb278-aee7-4649-97ce-a42f813330b0 req-0d052860-f587-4c5d-b46a-15fcbc25e6d3 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:55.959375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-b42bb278-aee7-4649-97ce-a42f813330b0 req-0d052860-f587-4c5d-b46a-15fcbc25e6d3 service nova] Creating event network-vif-plugged:5276e6ba-9658-4499-ac62-9419dd84fc02 for instance c947da6f-4d8e-46ce-8eba-63c9f3093204 on hv-cinder-82808 Feb 15 03:02:55.959897 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-b42bb278-aee7-4649-97ce-a42f813330b0 req-0d052860-f587-4c5d-b46a-15fcbc25e6d3 service nova] Creating event network-vif-plugged:fcb04533-33a8-4b4f-a640-9248b6f38139 for instance 2afb1287-b39f-4fd6-8b4a-c03103fcae40 on hv-cinder-82808 Feb 15 03:02:55.977637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-b42bb278-aee7-4649-97ce-a42f813330b0 req-0d052860-f587-4c5d-b46a-15fcbc25e6d3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103831 Feb 15 03:02:55.985329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 43/83] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:02:55.997718 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:56.013453 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:56.037810 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:56.038412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:56.044148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:56.044611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:56.680873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:56.699718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8f2a0109-b22a-436f-a888-fc2e639302d3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.908805 Feb 15 03:02:56.701336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 41/84] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:55 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:56.711774 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:56.713173 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:56.724901 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:56.727088 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:56.728916 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:56.729968 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:57.005296 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:57.015581 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:57.019759 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:57.022243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a42d106e-bbdb-4733-bf40-cb816a44d71d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.319251 Feb 15 03:02:57.024225 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 42/85] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:02:56 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:02:57.429544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:57.444512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a11bbfa8-95d5-4bdf-82ed-5f672922baa0 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1314 microversion: 2.1 time: 1.456541 Feb 15 03:02:57.445777 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 44/86] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:55 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1314 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:57.732722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:57.733969 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:57.741571 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:57.742955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:57.744123 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:57.744631 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:58.052170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:58.053667 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:58.074473 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:58.075564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:58.077319 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:58.079606 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:58.381098 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:58.420199 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-dc01f300-a29f-4c54-b353-10b8e1c0bb11 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.691345 Feb 15 03:02:58.421533 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 43/87] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:57 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:02:58.475292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:58.479872 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:58.512445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:58.513177 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:58.515073 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:58.515843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:58.915785 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:58.961597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:58.970463 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:58.974126 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4e83128a-0e3c-490a-9202-ee8a25125f8e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.926857 Feb 15 03:02:58.977673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 45/88] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:02:58 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:02:59.013846 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-f75defab-92d9-47c1-afba-b5a94d7b0c17 req-6cdab549-e5b9-44f9-ad3e-4390120e7c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:02:59.024920 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:02:59.024920 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:02:59.060387 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-f75defab-92d9-47c1-afba-b5a94d7b0c17 req-6cdab549-e5b9-44f9-ad3e-4390120e7c6b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:59.063278 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-f75defab-92d9-47c1-afba-b5a94d7b0c17 req-6cdab549-e5b9-44f9-ad3e-4390120e7c6b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:59.116800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-f75defab-92d9-47c1-afba-b5a94d7b0c17 req-6cdab549-e5b9-44f9-ad3e-4390120e7c6b service nova] Creating event network-changed:5bc40f19-47a8-4cc5-a5e3-1c35392b5b48 for instance 73cd6519-d67b-4635-af86-336ae2fde18b on hv-cinder-82808 Feb 15 03:02:59.146527 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-f75defab-92d9-47c1-afba-b5a94d7b0c17 req-6cdab549-e5b9-44f9-ad3e-4390120e7c6b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166125 Feb 15 03:02:59.150293 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:59.156779 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 46/89] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:02:59.173987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fc78b444-3533-448e-b46a-46fca8a23d77 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1502 microversion: 2.1 time: 0.704560 Feb 15 03:02:59.176686 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 44/90] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:58 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1502 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:02:59.454922 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:02:59.457570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:02:59.475829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:59.476841 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:59.478548 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:02:59.479807 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:02:59.755188 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:02:59.770728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b457b93f-2e8e-4333-bd3d-d8096421fade tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.326146 Feb 15 03:02:59.771876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 47/91] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:02:59 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:00.012501 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:00.013639 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:00.024449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:00.025788 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:00.027452 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:00.028749 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:00.330887 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:00.340251 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:00.342170 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:00.343853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1374f3f6-7dbd-4f34-bede-f8170b9a7ae6 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.339019 Feb 15 03:03:00.345042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 45/92] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:00 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:00.803597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:00.804605 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:00.822536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:00.824083 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:00.825803 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:00.826909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:01.367184 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:01.369005 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:01.385632 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:01.386130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:01.386995 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:01.387634 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:01.550811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:01.575795 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b8a9a4e9-f46f-4b54-8843-5ee267ed82fd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.779269 Feb 15 03:03:01.584408 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 48/93] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:00 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:01.684874 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:01.697622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:01.699927 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:01.701977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-85bf4f2d-a459-4844-b503-151b09aaa36f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.342108 Feb 15 03:03:01.702898 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 46/94] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:01 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:02.610434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:02.611625 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:02.624219 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:02.625517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:02.629400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:02.630559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:02.735720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:02.738590 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:02.761399 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:02.763048 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:02.765668 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:02.767354 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:02.958517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:02.981655 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a5b885cb-7ef1-4ec8-8ea7-2c8b4d89d6fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1322 microversion: 2.1 time: 0.374711 Feb 15 03:03:02.986519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 49/95] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:02 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:03.043463 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:03.050747 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:03.052299 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:03.053889 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a6a0f323-deb7-4b8e-98ca-8e8af08aaa25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.334942 Feb 15 03:03:03.054469 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 47/96] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:02 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:04.015341 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:04.016622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:04.037673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.039074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.040869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.041768 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.087669 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:04.093720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:04.120190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.121913 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.123751 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.124787 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.526505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:04.544982 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:04.547818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:04.550886 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1eac8533-7aee-4b0c-9f66-0b8c715a4602 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.471858 Feb 15 03:03:04.552252 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 48/97] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:04 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:04.589680 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:04.608758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-23e91fd1-5c49-4320-9ee6-fac32cb233c3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1517 microversion: 2.1 time: 0.607878 Feb 15 03:03:04.622227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 50/98] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:03 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1517 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:04.632244 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:04.636869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:04.660164 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.660809 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.663248 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.664457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.745568 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lazy-loading 'flavor' on Instance uuid 2afb1287-b39f-4fd6-8b4a-c03103fcae40 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:03:04.909116 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d5a45a44-bec2-4a93-b30a-b9568c235ce4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40/action" status: 200 len: 32 microversion: 2.1 time: 0.282518 Feb 15 03:03:04.915022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 49/99] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:03:04 2022] POST /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40/action => generated 32 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:03:04.922378 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:04.922378 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:04.936619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.938267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:04.941172 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:04.941692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:05.134309 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:05.147430 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f6d8e085-48a1-4c5e-bb4a-ff7e0c0dc18d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.231633 Feb 15 03:03:05.149399 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 51/100] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:04 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:05.247011 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9286191-5184-4bc0-bee7-1d06d8cd1194"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:05.248251 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:05.255897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:05.256449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:05.257779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:05.258243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:05.577080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:05.578618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:05.589928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:05.590847 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:05.592440 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:05.593236 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:05.952859 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:05.969434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:05.973636 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:05.975943 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f2273a11-c032-47e0-a452-5b89a0a39f7f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.406029 Feb 15 03:03:05.977696 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 52/101] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:05 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:06.167061 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:06.168570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:06.176801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:06.177325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:06.178325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:06.178850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:06.380210 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:06.388489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-df2cc08a-bb0c-4073-934b-09180ea81a85 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.225251 Feb 15 03:03:06.389193 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 53/102] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:06 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:07.015458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:07.019117 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:07.031559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:07.032789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:07.034586 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:07.035660 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:07.370479 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:07.392209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:07.396677 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:07.399508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b038bd3c-032c-4cb5-985f-d9d27d4e445f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.394649 Feb 15 03:03:07.401647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 54/103] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:07 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:07.411345 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:07.412928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:07.426964 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:07.428512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:07.430693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:07.432087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:07.755784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:07.779927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6b7b8333-a531-4642-b07f-49ff3899e955 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.372759 Feb 15 03:03:07.786529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 55/104] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:07 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:07.855550 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-83fe9ea8-6845-4715-9b85-f5abf63e7586 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "POST /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.611465 Feb 15 03:03:07.856410 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 50/105] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:03:05 2022] POST /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354/os-volume_attachments => generated 194 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:03:08.421476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:08.422276 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:08.432270 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:08.434144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:08.436128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:08.437696 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:08.741335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:08.757885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:08.759555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:08.760734 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6a3858b0-7eca-4eb6-bf45-2c6781a9955f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.342996 Feb 15 03:03:08.761376 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 56/106] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:08 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:08.805781 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:08.806483 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:08.818684 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:08.819325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:08.820063 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:08.820535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:09.040529 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:09.049361 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1a7a2139-93c5-44ee-82dc-dd66d36737b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.247064 Feb 15 03:03:09.051422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 51/107] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:08 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:09.782857 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:09.783932 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:09.793622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:09.794716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:09.797020 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:09.798838 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:10.035855 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:10.055813 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:10.060233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:10.062632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6744dacb-bf4e-4fa8-b947-cddc4392e2bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.285368 Feb 15 03:03:10.064683 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 57/108] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:09 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:10.085263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:10.086843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:10.101142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:10.102357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:10.104320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:10.105483 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:10.453037 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:10.471314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d2bd8a1f-ad65-41e1-9f95-a5e2a5c5577e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.392107 Feb 15 03:03:10.473333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 52/109] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:10 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:11.087310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:11.088711 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:11.098684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:11.099674 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:11.101408 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:11.102164 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:11.334155 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:11.347877 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:11.350764 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:11.352900 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-812348cf-fafa-463a-98a7-0483a032d67b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.271568 Feb 15 03:03:11.354000 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 58/110] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:11 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:11.490756 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:11.491406 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:11.503959 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:11.504676 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:11.505713 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:11.506352 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:11.865009 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:11.879787 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b6952458-c7cc-43a9-91b1-384a30f25985 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.392820 Feb 15 03:03:11.880961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 53/111] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:11 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:12.378756 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:12.380018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:12.387969 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:12.388417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:12.389715 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:12.390102 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:12.658901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:12.685368 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:12.690169 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:12.692481 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a1e5da9e-8912-4b3e-a797-c98f468dda6b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.319876 Feb 15 03:03:12.693831 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 59/112] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:12 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:03:12.909264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:12.910099 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:12.917408 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:12.917878 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:12.918697 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:12.919175 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:13.126373 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:13.140399 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3c8e6b6d-e828-41a7-8484-f2e690a772b0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.234966 Feb 15 03:03:13.141474 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 54/113] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:12 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:13.726992 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:13.728122 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:13.737250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:13.737724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:13.738559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:13.738999 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:13.951058 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:13.967382 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:13.971345 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:13.973571 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-bf9e21de-3913-41cc-b5be-e4a28b9b6342 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.263788 Feb 15 03:03:13.975297 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 60/114] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:13 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:14.159656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:14.160294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:14.166791 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:14.167302 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:14.168084 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:14.168527 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:14.353897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:14.362321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-64e8c002-87ed-444a-92cf-c9f43d8023cc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.206921 Feb 15 03:03:14.363126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 55/115] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:14 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:14.999063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:15.000293 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:15.014555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:15.015378 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:15.016763 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:15.017624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:15.181477 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:15.190869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:15.192631 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:15.193819 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a5817e0b-e0fe-4a2a-a72b-353bb745846f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.202408 Feb 15 03:03:15.194425 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 61/116] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:14 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:15.383059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:15.384510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:15.397841 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:15.398621 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:15.400154 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:15.401101 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:15.624240 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:15.634097 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9ba6b31d-3775-4238-ad93-8c1b6911442b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.257701 Feb 15 03:03:15.634854 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 56/117] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:15 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:16.212993 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:16.213611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:16.222406 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:16.222829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:16.223667 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:16.224094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:16.374978 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:16.383517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:16.385036 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:16.386166 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1da20931-367f-4c0c-a212-0b066d35fe52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.177153 Feb 15 03:03:16.386741 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 62/118] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:16 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:16.655210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:16.656014 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:16.664026 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:16.664475 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:16.665282 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:16.665717 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:16.860244 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:16.873992 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-daa2e513-c25e-4e33-ac96-6dbb92bf1aab tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.222012 Feb 15 03:03:16.875527 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 57/119] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:16 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:17.405634 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:17.406237 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:17.412704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:17.413143 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:17.413925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:17.414358 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:17.582002 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:17.590260 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:17.591804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:17.592941 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-002c23f1-64af-4ff6-9b8d-096d923d7340 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.190984 Feb 15 03:03:17.593790 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 63/120] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:17 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:17.893571 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:17.894318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:17.901149 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:17.901598 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:17.902391 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:17.902906 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:18.089556 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:18.104566 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bdd732e5-828d-4631-b593-4103fa8e7922 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.215245 Feb 15 03:03:18.105642 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 58/121] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:17 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:18.615145 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:18.616374 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:18.626769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:18.627541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:18.628956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:18.629767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:18.815074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:18.824169 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:18.825731 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:18.826940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ced4a98e-2a79-4dd9-a0b6-2acf5402ac21 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.218369 Feb 15 03:03:18.827605 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 64/122] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:18 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:19.123085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:19.123891 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:19.132206 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:19.132784 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:19.134771 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:19.135473 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:19.380551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:19.388779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-67934a29-57fe-410e-b897-6d4b6dafc6cf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.269825 Feb 15 03:03:19.389378 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 59/123] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:19 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:19.846704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:19.847434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:19.854488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:19.854943 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:19.855774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:19.856213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:20.004958 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:20.013416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:20.014926 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:20.016104 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ea980486-4b01-4c46-9f97-2338a177ea3f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.175328 Feb 15 03:03:20.016699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 65/124] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:19 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:20.406130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:20.406811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:20.419031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:20.419894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:20.421640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:20.422616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:20.425886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-031f9caa-60f9-4fd2-a883-fbdc9f7f7fa0 req-6cf67c27-6108-430a-88b5-11f39fe0e284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "name": "network-vif-plugged", "status": "completed", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:20.427964 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:03:20.427964 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:03:20.437545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-031f9caa-60f9-4fd2-a883-fbdc9f7f7fa0 req-6cf67c27-6108-430a-88b5-11f39fe0e284 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:20.438078 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-031f9caa-60f9-4fd2-a883-fbdc9f7f7fa0 req-6cf67c27-6108-430a-88b5-11f39fe0e284 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:20.455722 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-031f9caa-60f9-4fd2-a883-fbdc9f7f7fa0 req-6cf67c27-6108-430a-88b5-11f39fe0e284 service nova] Creating event network-vif-plugged:5bc40f19-47a8-4cc5-a5e3-1c35392b5b48 for instance 73cd6519-d67b-4635-af86-336ae2fde18b on hv-cinder-82808 Feb 15 03:03:20.461563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-031f9caa-60f9-4fd2-a883-fbdc9f7f7fa0 req-6cf67c27-6108-430a-88b5-11f39fe0e284 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042262 Feb 15 03:03:20.462646 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 66/125] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:03:20.617718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:20.625743 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bbdf79dc-8b22-45d7-87fe-c0c69db97a28 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.223648 Feb 15 03:03:20.626584 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 60/126] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:20 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:21.036699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:21.037445 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:21.046728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:21.047595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:21.049537 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:21.050337 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:21.233990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:21.243031 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:21.244646 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:21.245799 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5d069daf-1376-4ab8-afdd-db598a4dee83 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.213960 Feb 15 03:03:21.246367 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 67/127] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:21 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:21.643257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:21.643895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:21.650982 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:21.651487 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:21.652336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:21.652804 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:21.818517 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:21.826752 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cc7b28d0-bd6a-44ec-ae16-c3a29549d470 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.187383 Feb 15 03:03:21.827382 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 61/128] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:21 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:22.264674 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:22.265472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:22.273362 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:22.273818 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:22.274776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:22.275323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:22.432054 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:22.447011 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:22.449476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:22.451852 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-63cfcfec-7d03-43bd-a0af-85cf01ce3898 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.191007 Feb 15 03:03:22.453176 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 68/129] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:22 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:22.845477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:22.846182 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:22.852963 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:22.853640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:22.854624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:22.855375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:23.022714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:23.038101 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d7c93832-9028-42f4-bc89-c1ae058820aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.196272 Feb 15 03:03:23.039713 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 62/130] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:22 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:23.481504 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:23.482108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:23.488829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:23.489281 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:23.490091 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:23.490530 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:23.699949 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:23.712700 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:23.716353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:23.719015 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b9fb9290-63d0-4419-becd-5b9c6f5c9785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.241374 Feb 15 03:03:23.720662 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 69/131] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:23 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:24.061640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:24.062743 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:24.075129 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:24.075990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:24.077427 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:24.078206 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:24.253574 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:24.270387 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d361ada4-2a74-4a0f-b516-46e0e6316481 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.215612 Feb 15 03:03:24.272497 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 63/132] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:24 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:24.742977 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:24.744138 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:24.753789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:24.754360 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:24.755784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:24.756566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:24.929717 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:24.947933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:24.952714 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:24.956473 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9201db72-c755-4674-91e5-4d1996ae9b37 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.220780 Feb 15 03:03:24.958847 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 70/133] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:24 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:25.302650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:25.303343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:25.310535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:25.311007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:25.311866 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:25.312294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:25.510314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:25.519708 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8491b714-2605-4f22-804e-6579290c759b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.221527 Feb 15 03:03:25.520306 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 64/134] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:25 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:25.981760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:25.982605 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:25.990196 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:25.990616 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:25.991543 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:25.991969 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:26.277322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:26.291083 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:26.294291 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:26.296354 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8822ee35-cc1f-422a-afb9-b5f226fd68ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1405 microversion: 2.20 time: 0.318523 Feb 15 03:03:26.297502 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 71/135] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:25 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:26.544923 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:26.546064 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:26.558405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:26.559643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:26.561413 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:26.562573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:26.988724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:26.990142 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:27.020724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.021468 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.022529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.023203 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.054627 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:03:27.146705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:27.162977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c7101ed4-e23a-4004-b3ea-da407c2b4bed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.625920 Feb 15 03:03:27.164694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 65/136] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:26 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:27.338288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:27.348710 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:27.363511 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.364302 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.365726 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.366495 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.444129 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dbedf269-18c1-4242-8d50-7d1d20b9b40f tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 204 len: 0 microversion: 2.1 time: 0.459238 Feb 15 03:03:27.445690 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 72/137] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:03:26 2022] DELETE /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:03:27.455885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:27.456604 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:27.464164 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.464574 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.465387 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.465821 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.679371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:27.699380 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:27.702426 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:27.709348 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:27.711184 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-edc53ea1-51ee-4b84-bb23-944db7a57824 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1597 microversion: 2.20 time: 0.388657 Feb 15 03:03:27.729578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4a8e7f41-47a2-4a18-a5db-54190dea4444 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1554 microversion: 2.1 time: 0.278917 Feb 15 03:03:27.730403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 73/138] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:27 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:27.738216 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 66/139] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:03:27 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1597 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:03:27.743302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:27.744521 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:27.752314 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.753574 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.754548 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:27.755552 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:27.917558 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1c284a08-6335-43df-9e5b-f4b65f429f0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.177714 Feb 15 03:03:27.919302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 74/140] 10.222.0.24 () {60 vars in 1315 bytes} [Tue Feb 15 03:03:27 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:03:28.193377 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:28.194164 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:28.209739 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:28.210787 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:28.222580 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:28.223320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:28.513316 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:28.526478 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-aadfa4cf-ab5e-458f-9eb1-cc304b648f6a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.338757 Feb 15 03:03:28.527755 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 67/141] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:28 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:28.757413 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:28.759327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:28.768362 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:28.769299 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:28.770366 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:28.771058 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:29.473256 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:29.483749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-904b22fa-99c8-4e39-b5b7-a0f2fc12e30c tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1554 microversion: 2.1 time: 0.732366 Feb 15 03:03:29.496461 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 75/142] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:28 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1554 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:29.547445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:29.549332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:29.557894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:29.561737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:29.561737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:29.564902 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:29.788491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:29.803911 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9dab04e6-4840-404a-a0f8-31e74684d068 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.261922 Feb 15 03:03:29.823940 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 68/143] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:29 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:30.513453 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:30.515659 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:30.527406 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:30.528233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:30.529722 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:30.530528 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:30.843823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:30.843823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:30.856830 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:30.857771 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:30.861727 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:30.862665 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:30.978356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:30.989468 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6e391d34-1fa1-408d-b4e5-22abb84d6147 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1554 microversion: 2.1 time: 0.482521 Feb 15 03:03:30.990869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 76/144] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:30 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1554 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:30.996200 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:30.996983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:31.005472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:31.006317 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:31.007634 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:31.008470 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:31.069155 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-54a846a9-0d49-4986-85fd-431e3fe70785 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/ips" status: 200 len: 112 microversion: 2.20 time: 0.076282 Feb 15 03:03:31.080941 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 77/145] 10.222.0.24 () {60 vars in 1288 bytes} [Tue Feb 15 03:03:30 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/ips => generated 112 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:03:31.091404 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-3e1762c3-0da9-451c-a75e-299af9d123b7 req-f6fcb156-5a87-4133-8a9e-6967466a01e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:31.096954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:03:31.096954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:03:31.119265 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3e1762c3-0da9-451c-a75e-299af9d123b7 req-f6fcb156-5a87-4133-8a9e-6967466a01e6 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:31.119473 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3e1762c3-0da9-451c-a75e-299af9d123b7 req-f6fcb156-5a87-4133-8a9e-6967466a01e6 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:31.136351 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-3e1762c3-0da9-451c-a75e-299af9d123b7 req-f6fcb156-5a87-4133-8a9e-6967466a01e6 service nova] Creating event network-changed:5bc40f19-47a8-4cc5-a5e3-1c35392b5b48 for instance 73cd6519-d67b-4635-af86-336ae2fde18b on hv-cinder-82808 Feb 15 03:03:31.143709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-3e1762c3-0da9-451c-a75e-299af9d123b7 req-f6fcb156-5a87-4133-8a9e-6967466a01e6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061006 Feb 15 03:03:31.149544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 78/146] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:03:31.239351 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:31.263083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9fec07a8-7100-499c-b72f-f6f555d2fa96 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.433775 Feb 15 03:03:31.283022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 69/147] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:30 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:32.022004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:32.023602 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:32.034088 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:32.037485 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:32.041882 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:32.044020 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:32.298488 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:32.303992 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:32.364752 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:32.368611 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:32.372818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:32.373945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:32.779551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:32.782333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:32.799831 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e41b4182-7ee8-474f-be57-2dc6d3e8fc41 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1554 microversion: 2.1 time: 0.781794 Feb 15 03:03:32.811013 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 79/148] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:32 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1554 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:32.820954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0ff19e7b-943b-4162-9308-36463dc115bf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.530370 Feb 15 03:03:32.832025 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 70/149] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:32 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:33.382021 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-3915c3d4-8fb2-435a-be24-fcf46f496bab req-c879df9b-c72e-48d5-b95a-4a3d3b693785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0499b0-e6f2-4496-9be3-ab51a3132354", "name": "network-vif-deleted", "tag": "fdb2ff78-1b2a-416b-929c-83b03b4627aa"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:33.386987 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:03:33.386987 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:03:33.419803 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3915c3d4-8fb2-435a-be24-fcf46f496bab req-c879df9b-c72e-48d5-b95a-4a3d3b693785 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:33.419803 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3915c3d4-8fb2-435a-be24-fcf46f496bab req-c879df9b-c72e-48d5-b95a-4a3d3b693785 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:33.431887 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-3915c3d4-8fb2-435a-be24-fcf46f496bab req-c879df9b-c72e-48d5-b95a-4a3d3b693785 service nova] Creating event network-vif-deleted:fdb2ff78-1b2a-416b-929c-83b03b4627aa for instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 on hv-cinder-82808 Feb 15 03:03:33.437551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-3915c3d4-8fb2-435a-be24-fcf46f496bab req-c879df9b-c72e-48d5-b95a-4a3d3b693785 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059877 Feb 15 03:03:33.439656 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 80/150] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:03:33.823565 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:33.824678 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:33.841311 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:33.842510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:33.844209 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:33.847429 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:33.853321 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:33.854088 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:33.868782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:33.869399 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:33.876633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:33.877234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:33.979405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:34.020284 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-afee1f5b-b72a-403a-958d-0468eb0f2c65 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1345 microversion: 2.1 time: 0.200907 Feb 15 03:03:34.021190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 71/151] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:33 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:34.090885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:34.099429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2e3d7862-200c-4257-a1bf-fa82a9299c89 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.251053 Feb 15 03:03:34.100027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 81/152] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:33 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:35.057543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:35.058589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:35.072471 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:35.074189 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:35.077007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:35.087556 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:35.121554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:35.122276 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:35.132522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:35.136699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:35.138561 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:35.142267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:35.175731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:35.176082 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:35.176641 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lazy-loading 'fault' on Instance uuid 8e0499b0-e6f2-4496-9be3-ab51a3132354 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:03:35.241367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:35.249671 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f2ea282a-1a26-4b06-ab96-0861bea10e2d tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1350 microversion: 2.1 time: 0.198876 Feb 15 03:03:35.250219 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 72/153] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:35 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1350 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:35.345974 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:35.356359 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ccc04aa0-8736-47b9-8ab9-cb02fe97bf88 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.241893 Feb 15 03:03:35.357198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 82/154] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:35 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:36.268272 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:36.269049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:36.276059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:36.276519 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:36.277356 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:36.277791 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:36.311776 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:36.312273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:36.312904 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lazy-loading 'fault' on Instance uuid 8e0499b0-e6f2-4496-9be3-ab51a3132354 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:03:36.355682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6297e603bae045c1870a54fe6c5c5593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d6a0518ac743a5977510bac8e9e8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:36.365689 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-41b1bff9-18a9-4422-9f9a-d259218e0a72 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 200 len: 1350 microversion: 2.1 time: 0.103448 Feb 15 03:03:36.366285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 73/155] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:36 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:36.374197 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:36.374931 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:36.383195 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:36.383692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:36.384452 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:36.384886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:36.542884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:36.554090 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9984834a-5d49-4d7a-bfb4-d82bcf100b3c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.183839 Feb 15 03:03:36.554827 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 83/156] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:36 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:37.383250 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:37.384041 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:37.391965 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:37.391965 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:37.392813 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:37.393420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:37.410229 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] HTTP exception thrown: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. Feb 15 03:03:37.410875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Returning 404 to user: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:03:37.411953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-07534fbe-9daa-45e7-a5a5-62fb694cf738 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 404 len: 111 microversion: 2.1 time: 0.032561 Feb 15 03:03:37.412541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 74/157] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:37 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:03:37.537656 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:37.538770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:37.545366 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:37.545824 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:37.546624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:37.547060 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:37.563886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] HTTP exception thrown: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. Feb 15 03:03:37.564692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Returning 404 to user: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:03:37.565666 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8ef2ec85-349a-4951-bb89-6a24fdfa0378 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032432 Feb 15 03:03:37.566414 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 84/158] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:03:37 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:03:37.574590 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:37.575256 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:37.583788 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:37.584234 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:37.585026 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:37.585456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:37.788773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:37.801843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ae7f8fa7-5021-44e2-8a3b-8f4cb4f91422 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.232677 Feb 15 03:03:37.802448 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 75/159] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:37 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:38.820571 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:38.821359 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:38.833573 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:38.834293 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:38.835391 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:38.835589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:38.836313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:38.836448 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:38.844074 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:38.844556 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:38.845597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:38.846235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:38.864209 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] HTTP exception thrown: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. Feb 15 03:03:38.865059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Returning 404 to user: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:03:38.866135 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-80ffcc05-36c0-42b9-a7fc-b0ea611f48a8 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 404 len: 111 microversion: 2.1 time: 0.035636 Feb 15 03:03:38.867010 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 76/160] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:03:38 2022] DELETE /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 03:03:38.876488 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:38.877213 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] [instance: 8e0499b0-e6f2-4496-9be3-ab51a3132354] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:38.883896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:38.884604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:38.885649 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:38.886129 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:38.902571 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] HTTP exception thrown: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. Feb 15 03:03:38.903313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] Returning 404 to user: Instance 8e0499b0-e6f2-4496-9be3-ab51a3132354 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:03:38.905704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-db09ae84-85ad-4174-9b25-def9212f03d4 tempest-DeleteServersTestJSON-1662444807 tempest-DeleteServersTestJSON-1662444807-project] 10.222.0.24 "GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354" status: 404 len: 111 microversion: 2.1 time: 0.033965 Feb 15 03:03:38.906443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 77/161] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:38 2022] GET /compute/v2.1/servers/8e0499b0-e6f2-4496-9be3-ab51a3132354 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:03:39.072532 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:39.082965 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f0787733-12b5-46ec-bd5c-f4e902ccb903 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.266035 Feb 15 03:03:39.087553 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 85/162] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:38 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:40.112396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:40.113677 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:40.125766 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:40.127344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:40.128812 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:40.129616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:40.486334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:40.495599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7639e248-fe3a-4d26-9c10-90f45990e5dc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.392289 Feb 15 03:03:40.496185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 78/163] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:40 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:41.515555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:41.517840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:41.525176 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:41.525635 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:41.526784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:41.527535 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:41.764885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:41.774440 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c98cfd8f-5993-43c6-a1e0-2cab46aa8124 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.262879 Feb 15 03:03:41.775078 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 86/164] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:41 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:42.796640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:42.798270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:42.808181 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:42.808894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:42.810520 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:42.811284 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:43.102975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:43.137702 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-395a6331-0a46-49c6-85c2-94d0e175a77c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.345183 Feb 15 03:03:43.139487 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 79/165] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:42 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:44.172074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:44.173401 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:44.192333 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:44.193201 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:44.195122 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:44.196329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:44.537131 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:44.569566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d02f28e0-446a-4c98-a57e-edf96151dd43 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.403148 Feb 15 03:03:44.573297 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 87/166] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:44 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:45.599820 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:45.603598 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:45.651490 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:45.661418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:45.663790 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:45.675789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:46.679185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:46.715358 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3130f5a8-6197-4902-9345-252a842b16a9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 1.128402 Feb 15 03:03:46.740521 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 80/167] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:45 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:47.755767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:47.756778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:47.771179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:47.772132 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:47.773798 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:47.775372 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:48.083402 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:48.099253 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1c6a0513-aadd-4e9b-b79a-527652c73004 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.353825 Feb 15 03:03:48.099917 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 88/168] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:47 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:49.119714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:49.122127 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:49.143023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:49.144976 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:49.148569 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:49.149094 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:49.811495 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:49.834444 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-05787f3e-fddc-498d-83af-1a09d8745f7f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.719113 Feb 15 03:03:49.844576 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 81/169] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:49 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:50.878035 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:50.880057 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:50.911413 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:50.912818 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:50.917848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:50.918667 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:51.646740 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:51.674243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-291454d2-e1f3-4976-8ade-c4ab1cdf5160 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.804202 Feb 15 03:03:51.674829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 89/170] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:50 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:52.694245 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:52.695115 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:52.702486 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:52.704260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:52.712042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:52.712958 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:53.117401 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:53.127136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-46e20cd4-291f-4979-b8c7-4bf85ffeef87 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.437351 Feb 15 03:03:53.132420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 82/171] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:52 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:54.161799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:54.163951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:54.180367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:54.181285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:54.182913 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:54.184066 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:54.475094 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:54.484723 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e1795b49-a77f-425f-9d75-7ddb399e7826 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1523 microversion: 2.1 time: 0.335327 Feb 15 03:03:54.485709 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 83/172] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:54 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:54.537087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a8c8c530-86f1-4388-9390-e041287a531b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: .version_select at 0x7fe7536a6430>, body: {"keypair": {"name": "tempest-keypair-1071933334"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:54.577735 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-a8c8c530-86f1-4388-9390-e041287a531b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:03:54.589893 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-a8c8c530-86f1-4388-9390-e041287a531b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for user c432dc1a98af4de28833f18c3b7ff6f8 and project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:03:55.230842 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-a8c8c530-86f1-4388-9390-e041287a531b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:03:55.235793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-a8c8c530-86f1-4388-9390-e041287a531b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for user c432dc1a98af4de28833f18c3b7ff6f8 and project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:03:55.257570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a8c8c530-86f1-4388-9390-e041287a531b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.232891 Feb 15 03:03:55.258564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 90/173] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Feb 15 03:03:54 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:55.503078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:55.504519 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:55.522261 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:55.523048 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:55.524152 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:55.526089 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:55.919420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:55.933374 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bc56676b-b2c0-4e53-98d8-7dbd113b7d79 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1503 microversion: 2.1 time: 0.434750 Feb 15 03:03:55.934399 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 84/174] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:55 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:03:55.955643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:55.957088 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:55.994090 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:55.994725 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:55.995852 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:55.996302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:56.394786 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:03:56.429431 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4ee177bb-c4aa-4724-bca9-ef9e60345aaf tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1516 microversion: 2.1 time: 0.478848 Feb 15 03:03:56.436033 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 91/175] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:55 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1516 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:03:58.532071 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-704457545", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09e6f2a7-989f-47d7-86f1-8f00da6255c2"}], "security_groups": [{"name": "tempest-securitygroup--2083676029"}], "key_name": "tempest-keypair-1071933334", "user_data": "}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:58.765422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] validate_networks() for [('09e6f2a7-989f-47d7-86f1-8f00da6255c2', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:03:59.226559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:03:59.229285 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:59.264443 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:59.268920 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:59.292105 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:59.293665 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:59.372038 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lazy-loading 'flavor' on Instance uuid c947da6f-4d8e-46ce-8eba-63c9f3093204 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:03:59.587418 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-95c5273e-ca21-451c-8eaf-df576b99ef06 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action" status: 200 len: 32 microversion: 2.1 time: 0.386833 Feb 15 03:03:59.589014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 92/176] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:03:59 2022] POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:03:59.612842 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:03:59.615708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:03:59.649998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:59.650758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:59.652074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:59.654621 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:59.931210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:03:59.932362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:03:59.933327 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:03:59.933848 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:03:59.934920 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:03:59.961837 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:59.962646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:03:59.965331 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:03:59.966792 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:00.012706 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:04:00.019731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for user c432dc1a98af4de28833f18c3b7ff6f8 and project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:04:00.047951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:04:00.048232 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:04:00.135949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-12361221-b4ca-4fdf-84c9-aaa85ea829e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.612132 Feb 15 03:04:00.137765 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 85/177] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:03:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:04:00.157732 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-254c0006-b449-484d-a810-1624799b8284 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:00.158804 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-254c0006-b449-484d-a810-1624799b8284 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:00.313677 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-254c0006-b449-484d-a810-1624799b8284 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:00.342046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:00.356310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-254c0006-b449-484d-a810-1624799b8284 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1237 microversion: 2.1 time: 0.206384 Feb 15 03:04:00.364205 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 86/178] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:00 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1237 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:00.374152 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-030e45cd-b617-4cab-b7f7-c96e9edc7bc3 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.773106 Feb 15 03:04:00.376714 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 93/179] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:03:59 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:01.382892 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:01.384857 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:01.396868 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:01.397436 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:01.398388 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:01.398873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:01.403110 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:01.403922 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:01.412738 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:01.413809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:01.414886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:01.415813 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:01.512192 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:01.525373 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a849eb76-7828-42c7-a8a2-3f4eee35c434 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1289 microversion: 2.1 time: 0.147909 Feb 15 03:04:01.526098 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 87/180] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:01 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:01.836154 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:01.845844 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5b57f117-b5d6-45b0-851a-85d25d79d77a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.456537 Feb 15 03:04:01.846687 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 94/181] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:01 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:02.552819 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:02.554230 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:02.562022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:02.563761 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:02.565882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:02.567432 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:02.677999 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:02.689311 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e9978065-3755-45fa-934b-90ea3f737241 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1295 microversion: 2.1 time: 0.140066 Feb 15 03:04:02.690191 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 88/182] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:02 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:02.869896 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:02.870733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:02.890125 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:02.891393 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:02.892313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:02.893078 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:03.329755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:03.339394 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6a04c378-72a8-4bfb-9e8a-7aaec67ea0c4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.476706 Feb 15 03:04:03.339973 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 95/183] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:02 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:03.716235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:03.718145 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:03.746190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:03.751970 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:03.753131 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:03.753812 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:04.069326 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:04.079013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-653c0b50-a8a8-4a14-afc4-829f2a10b691 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1363 microversion: 2.1 time: 0.367147 Feb 15 03:04:04.079635 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 89/184] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:03 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:04.153332 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-0be8ccf3-9b11-48dd-b1f5-b1e32930279c req-3eb84921-8cc0-408f-813c-22803766f2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dda008d-d3be-48d2-b87b-93c578e8d7b9", "tag": "80804951-baf1-4d2c-b5c1-cd973c73d75f"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:04.157317 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:04.157317 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:04:04.185111 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-0be8ccf3-9b11-48dd-b1f5-b1e32930279c req-3eb84921-8cc0-408f-813c-22803766f2f1 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:04.185837 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-0be8ccf3-9b11-48dd-b1f5-b1e32930279c req-3eb84921-8cc0-408f-813c-22803766f2f1 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:04.230111 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-0be8ccf3-9b11-48dd-b1f5-b1e32930279c req-3eb84921-8cc0-408f-813c-22803766f2f1 service nova] Creating event network-changed:80804951-baf1-4d2c-b5c1-cd973c73d75f for instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 on hv-cinder-82808 Feb 15 03:04:04.254796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-0be8ccf3-9b11-48dd-b1f5-b1e32930279c req-3eb84921-8cc0-408f-813c-22803766f2f1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099019 Feb 15 03:04:04.255578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 96/185] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:04.374696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:04.377069 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:04.390281 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:04.390877 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:04.391977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:04.392437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:04.743032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:04.756639 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ab5736b7-3f45-414b-a1da-d7dfaba5495c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.385753 Feb 15 03:04:04.757313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 90/186] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:04 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:05.097841 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:05.098744 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:05.105260 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:05.108730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:05.110794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:05.111493 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:05.501794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:05.547669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-56f6bb61-5b6d-4533-8ef2-48bf647e5e35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1363 microversion: 2.1 time: 0.444097 Feb 15 03:04:05.548671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 97/187] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:05 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:05.775838 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:05.776589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:05.788238 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:05.789423 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:05.791522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:05.792554 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:06.065585 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:06.074747 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-05f976b0-4c6d-4e43-9824-e509a72c5ae2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.303513 Feb 15 03:04:06.076162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 91/188] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:05 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:06.578165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:06.579287 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:06.591757 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:06.592412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:06.594545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:06.595633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:06.857459 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:06.871922 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-367d68ca-983f-41a4-89c7-d4c8053e7531 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1363 microversion: 2.1 time: 0.301102 Feb 15 03:04:06.872829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 98/189] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:06 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:07.104967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:07.106310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:07.118023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:07.119899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:07.121103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:07.123800 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:07.574586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:07.584468 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9bb62b9d-3fdc-48a9-b5ef-a2880110e0e1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.483913 Feb 15 03:04:07.584975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 92/190] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:07 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:07.936726 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:07.938001 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:07.961694 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:07.962536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:07.976511 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:07.977340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:08.341262 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:08.359749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3b38fa76-c0db-4f12-9a00-2b85b4106c63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1363 microversion: 2.1 time: 0.471381 Feb 15 03:04:08.361155 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 99/191] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:07 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:08.622151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:08.623403 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:08.640802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:08.642488 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:08.644072 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:08.645510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:08.862074 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:08.871033 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ac89a547-610f-465e-9dd0-8e3c5c9f44aa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.256366 Feb 15 03:04:08.872391 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 93/192] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:08 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:09.412013 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:09.415248 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:09.437451 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:09.437935 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:09.441340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:09.441918 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:09.461974 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-29d3c6ef-a246-4a80-bdb7-5ed579fe0e51 req-a3a02a0e-cc05-45e2-9f14-a410541e84e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dda008d-d3be-48d2-b87b-93c578e8d7b9", "name": "network-vif-plugged", "status": "completed", "tag": "80804951-baf1-4d2c-b5c1-cd973c73d75f"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:09.472392 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:09.472392 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:04:09.510049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-29d3c6ef-a246-4a80-bdb7-5ed579fe0e51 req-a3a02a0e-cc05-45e2-9f14-a410541e84e6 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:09.516993 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-29d3c6ef-a246-4a80-bdb7-5ed579fe0e51 req-a3a02a0e-cc05-45e2-9f14-a410541e84e6 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:09.594344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-29d3c6ef-a246-4a80-bdb7-5ed579fe0e51 req-a3a02a0e-cc05-45e2-9f14-a410541e84e6 service nova] Creating event network-vif-plugged:80804951-baf1-4d2c-b5c1-cd973c73d75f for instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 on hv-cinder-82808 Feb 15 03:04:09.603750 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-29d3c6ef-a246-4a80-bdb7-5ed579fe0e51 req-a3a02a0e-cc05-45e2-9f14-a410541e84e6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149012 Feb 15 03:04:09.605853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 94/193] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:09.803565 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:09.833755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-eb34299d-d7bf-4f4e-9397-b1fb09a5e851 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1363 microversion: 2.1 time: 0.450016 Feb 15 03:04:09.838550 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 100/194] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:09 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:09.896236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:09.900137 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:09.918648 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:09.919500 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:09.920875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:09.922230 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:10.144801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:10.145592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:10.157397 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:10.158675 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:10.160445 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:10.161208 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:10.235477 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lazy-loading 'flavor' on Instance uuid 73cd6519-d67b-4635-af86-336ae2fde18b {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:04:10.274559 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:10.304623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bd8739e1-d562-4d6e-be86-98179b594357 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.417571 Feb 15 03:04:10.306679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 95/195] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:09 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:10.660261 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-54af0abc-d4d5-4a5e-b222-bb821620710c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/action" status: 202 len: 0 microversion: 2.20 time: 0.521969 Feb 15 03:04:10.665885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 101/196] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Feb 15 03:04:10 2022] POST /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 15 03:04:10.672147 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:10.673375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:10.686892 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:10.689463 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:10.691648 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:10.694061 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:10.858100 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:10.859910 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:10.873388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:10.873837 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:10.875309 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:10.875768 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:11.119767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:11.136352 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:11.139234 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:11.143055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b6e7c1aa-ae66-4a41-99aa-8e0b292a0175 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.474875 Feb 15 03:04:11.144086 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 96/197] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:10 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:11.332374 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:11.333286 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:11.348294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:11.349259 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:11.350310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:11.350954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:11.567783 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:11.580477 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ac87678c-5825-4234-9832-d0f39fadfa45 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1363 microversion: 2.1 time: 0.730135 Feb 15 03:04:11.582889 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 102/198] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:10 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1363 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:11.678513 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:11.689118 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-21e0d8d5-35fa-413f-ac71-a97ea8015efa tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.362134 Feb 15 03:04:11.711598 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 97/199] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:11 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:12.185689 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:12.187183 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:12.204965 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:12.206241 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:12.208249 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:12.210989 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:12.603389 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:12.604197 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:12.613242 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:12.613980 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:12.614936 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:12.615530 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:12.807144 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:12.816899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9abc68f8-118d-440f-850a-818de61fc5a8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1548 microversion: 2.1 time: 0.218055 Feb 15 03:04:12.817573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 98/200] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:12 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1548 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:12.837953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:12.839142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:12.851889 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:12.852982 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:12.853999 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:12.854454 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:13.024336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:13.035849 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:13.041861 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:13.044246 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7a535019-de14-4013-93f7-f2275b1fcc34 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.880818 Feb 15 03:04:13.045411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 103/201] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:12 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:13.054957 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:13.055950 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:13.067923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:13.068848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:13.070567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:13.071641 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:13.126603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:13.135532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ad64c0d6-bd8d-4007-9260-4bf868e7d15d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.309084 Feb 15 03:04:13.136718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 99/202] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:12 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:13.320555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b9fcbd47-0fe9-491d-913c-8165941c2b0e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272122 Feb 15 03:04:13.321476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 104/203] 10.222.0.24 () {58 vars in 1274 bytes} [Tue Feb 15 03:04:13 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:14.066464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:14.067768 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:14.075323 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:14.076022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:14.076993 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:14.078254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:14.157525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:14.158597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:14.173925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:14.175295 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:14.179718 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:14.180604 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:14.422845 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:14.431599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:14.435472 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:14.440480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-58f2ccc4-03cd-4ca0-9f1c-83b5e3f357f1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.378504 Feb 15 03:04:14.456426 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 100/204] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:14 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:15.026934 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:15.054842 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4e069d4d-c778-4fc9-8707-a651bc78288b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.903482 Feb 15 03:04:15.071905 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 105/205] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:14 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:15.460279 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:15.461654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:15.469542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:15.470544 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:15.471722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:15.472519 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:15.616698 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:15.617206 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:15.624333 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:15.625158 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:15.626218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:15.626884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:15.657973 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6755cf75-54d3-4b49-b270-913a4cf44f7e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/ips" status: 200 len: 105 microversion: 2.1 time: 0.045765 Feb 15 03:04:15.660482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 106/206] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Feb 15 03:04:15 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/ips => generated 105 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:15.668800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-ce6c6314-f277-4ac5-8e07-f751844939d2 req-fdb03c23-0801-4ce0-94db-80c709cbdd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dda008d-d3be-48d2-b87b-93c578e8d7b9", "tag": "80804951-baf1-4d2c-b5c1-cd973c73d75f"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:15.674637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:15.674637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:04:15.696462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ce6c6314-f277-4ac5-8e07-f751844939d2 req-fdb03c23-0801-4ce0-94db-80c709cbdd59 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:15.702144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ce6c6314-f277-4ac5-8e07-f751844939d2 req-fdb03c23-0801-4ce0-94db-80c709cbdd59 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:15.727463 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-ce6c6314-f277-4ac5-8e07-f751844939d2 req-fdb03c23-0801-4ce0-94db-80c709cbdd59 service nova] Creating event network-changed:80804951-baf1-4d2c-b5c1-cd973c73d75f for instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 on hv-cinder-82808 Feb 15 03:04:15.732629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-ce6c6314-f277-4ac5-8e07-f751844939d2 req-fdb03c23-0801-4ce0-94db-80c709cbdd59 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070585 Feb 15 03:04:15.733292 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 107/207] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:15.916325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:15.949292 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:15.959628 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:15.961842 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-6615cb9e-c025-4486-84b5-50ae24479121 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.505135 Feb 15 03:04:15.963090 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 101/208] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:15 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:16.086148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:16.088161 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:16.105621 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:16.106478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:16.110572 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:16.111117 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:16.696553 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:16.707388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e4886fd2-bcfd-4557-9ea1-c3973418ad55 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1502 microversion: 2.1 time: 0.624069 Feb 15 03:04:16.719347 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 108/209] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:16 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1502 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:16.726858 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5210aab-6002-4177-92ec-57c59510ae35"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:16.728698 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:16.747188 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:16.754015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:16.755191 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:16.755816 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:16.805109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] HTTP exception thrown: Cannot 'attach_volume' instance c947da6f-4d8e-46ce-8eba-63c9f3093204 while it is in vm_state rescued Feb 15 03:04:16.806553 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Returning 409 to user: Cannot 'attach_volume' instance c947da6f-4d8e-46ce-8eba-63c9f3093204 while it is in vm_state rescued {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:04:16.810280 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-28ff53a8-be30-4bce-bdd5-2cbb6bad8893 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.085781 Feb 15 03:04:16.821149 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:16.821747 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:16.823380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 102/210] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:04:16 2022] POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 15 03:04:16.833903 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:16.834656 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:16.837686 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:16.838412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:16.986836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:16.987594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:16.999957 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:17.002538 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:17.003857 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:17.006569 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:17.021520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c7d6f720-c6bc-491e-8829-e337c52c0efb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action" status: 202 len: 0 microversion: 2.1 time: 0.204444 Feb 15 03:04:17.025702 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 109/211] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:04:16 2022] POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:04:17.035624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:17.048223 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:17.055277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:17.056009 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:17.056819 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:17.057387 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:17.432978 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:17.442797 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:17.450894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:17.456581 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3e38bc24-d692-4e24-8e94-c44f0090e740 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.478029 Feb 15 03:04:17.458220 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 103/212] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:16 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:17.548386 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:17.559137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-56cc997d-1028-48ca-9bd2-b5d23f470e46 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1510 microversion: 2.1 time: 0.531579 Feb 15 03:04:17.571068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 110/213] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:17 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:18.476851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:18.478300 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:18.485854 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:18.486542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:18.487616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:18.488434 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:18.578755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:18.579765 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:18.589188 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:18.589649 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:18.590455 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:18.590901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:18.683444 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:18.693457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:18.696253 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:18.697436 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-842bcb5f-bce6-4d80-a5f6-3a133c074c11 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.224510 Feb 15 03:04:18.698351 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 104/214] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:18 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:18.850589 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:18.860638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-af288356-aacf-4f9a-86bd-5d3d4ca478f9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1510 microversion: 2.1 time: 0.285962 Feb 15 03:04:18.867690 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 111/215] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:18 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:19.726405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:19.728387 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:19.742474 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:19.743798 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:19.745758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:19.746473 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:19.882707 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:19.884805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:19.913383 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:19.914269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:19.918377 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:19.922390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:20.369021 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:20.380588 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6e56b8d9-f900-4622-86c2-1d7b82011036 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1516 microversion: 2.1 time: 0.504798 Feb 15 03:04:20.383074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 112/216] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:19 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1516 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:20.410735 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:20.420890 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:20.424290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:20.427818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fe5a0c37-5cfd-4791-80d1-c45477e52919 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.712242 Feb 15 03:04:20.429113 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 105/217] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:19 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:21.456969 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:21.458209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:21.468752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:21.469766 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:21.470844 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:21.471536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:21.774274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:21.788114 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:21.789843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:21.791127 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-35401e58-8793-4d90-971a-2f16109b8e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.345496 Feb 15 03:04:21.802812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 113/218] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:21 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:21.900146 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:21.900772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:21.909856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:21.910373 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:21.914398 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:21.915018 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:22.563307 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:22.584067 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8aa4bcca-f36d-4dc8-a701-f549af89d674 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1516 microversion: 2.1 time: 0.687100 Feb 15 03:04:22.600394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 106/219] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:21 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1516 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:22.606984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ef3e0a2-3e59-4a32-90a3-c9cc067c1bf8"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:22.608145 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:22.616057 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:22.616766 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:22.617762 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:22.618383 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:22.826836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:22.828932 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:22.856270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:22.857151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:22.858341 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:22.859830 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:23.027187 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-427cbaf7-7b66-41fe-9b83-8d0b124882a5 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423977 Feb 15 03:04:23.028204 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 114/220] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:04:22 2022] POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:23.311009 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:23.342331 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:23.347207 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:23.348676 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d7b2bcf1-2a2e-44b0-b609-ae9ae660a678 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.541216 Feb 15 03:04:23.350003 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 107/221] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:22 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:24.373266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:24.375419 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:24.392918 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:24.393486 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:24.395595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:24.398278 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:24.848478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:24.862728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:24.864340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:24.868356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ff2e61fc-4139-46c6-a50e-6df0e8ef8fdf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.500365 Feb 15 03:04:24.868969 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 115/222] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:24 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:25.770118 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1980993730", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "9378a579-260b-4873-b61c-261899e7b0f3"}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:25.865957 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] validate_networks() for [('9378a579-260b-4873-b61c-261899e7b0f3', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:04:25.904108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:25.905942 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:25.916266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:25.917576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:25.918618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:25.919443 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:26.356007 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:26.376796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:26.383334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:26.386010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0fbb556b-2bb2-4c73-8e02-b1bcfb5457f7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.499830 Feb 15 03:04:26.398663 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 116/223] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:25 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:26.605419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:04:26.605842 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:04:26.606311 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:04:26.606718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:04:26.607125 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:04:26.631544 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:26.632273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:26.633268 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:26.633700 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:26.694052 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Getting quotas for project 303d2e285f594249875c9a3de44a5ac2. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:04:26.707381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Getting quotas for user bb2d306080c649b6af020eb43a44edb5 and project 303d2e285f594249875c9a3de44a5ac2. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:04:26.733190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:04:26.742872 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:04:26.869793 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ed117c73-1209-4dbf-b36d-12e43ec9815d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105989 Feb 15 03:04:26.872337 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 108/224] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:04:26.886290 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2a6f098b-8e27-413b-8ba3-8d5af7f1b636 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:26.887477 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2a6f098b-8e27-413b-8ba3-8d5af7f1b636 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:26.958597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2a6f098b-8e27-413b-8ba3-8d5af7f1b636 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:26.971354 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2a6f098b-8e27-413b-8ba3-8d5af7f1b636 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1219 microversion: 2.1 time: 0.088516 Feb 15 03:04:26.972427 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 117/225] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:26 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:27.416113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:27.416628 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:27.424113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:27.424763 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:27.425634 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:27.426136 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:27.631488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:27.646398 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:27.649125 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:27.651638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9718c017-71a2-40ea-bd91-1a83c94bdd25 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1743 microversion: 2.20 time: 0.239156 Feb 15 03:04:27.652677 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 118/226] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:27 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:27.731436 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0b681b2c-af54-4039-9a9c-e3a54527b2e7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Action: 'create', calling method: .version_select at 0x7fe75221fee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-385441723"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:27.756848 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-0b681b2c-af54-4039-9a9c-e3a54527b2e7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Getting quotas for project 21443331469a45f5b7d064a7f4513743. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:04:27.767744 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-0b681b2c-af54-4039-9a9c-e3a54527b2e7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Getting quotas for user b7950ed98cda4e27912a90c765e65930 and project 21443331469a45f5b7d064a7f4513743. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:04:27.975165 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-0b681b2c-af54-4039-9a9c-e3a54527b2e7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Getting quotas for project 21443331469a45f5b7d064a7f4513743. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:04:27.980780 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-0b681b2c-af54-4039-9a9c-e3a54527b2e7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Getting quotas for user b7950ed98cda4e27912a90c765e65930 and project 21443331469a45f5b7d064a7f4513743. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:04:27.998136 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:27.999806 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:28.011434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:28.012243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:28.013351 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0b681b2c-af54-4039-9a9c-e3a54527b2e7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.607868 Feb 15 03:04:28.014270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 109/227] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Feb 15 03:04:27 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:28.023717 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:28.029664 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:28.167578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:28.187563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d830dbb6-2717-4564-926a-e72f12f58810 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1271 microversion: 2.1 time: 0.195041 Feb 15 03:04:28.207567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 119/228] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:27 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:28.673872 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:28.674724 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:28.683563 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:28.684440 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:28.685455 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:28.686090 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:28.972294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:28.987833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:28.998385 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:29.004174 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4a4c6622-90cf-4327-a8d7-144b74a55cbf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1743 microversion: 2.20 time: 0.331571 Feb 15 03:04:29.009185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 110/229] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:28 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1743 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:29.225079 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:29.225804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:29.233112 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:29.234022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:29.235359 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:29.236005 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:29.629220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:29.640572 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b21aed60-42b3-4cd0-9423-584c0635ba5e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.426583 Feb 15 03:04:29.652954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 120/230] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:29 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:30.029053 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:30.029679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:30.044863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:30.048177 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:30.049437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:30.052151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:30.460754 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:30.479688 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:30.487594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:30.489339 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-303af7d3-7f69-4c5b-bb83-4ba631e38236 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.464806 Feb 15 03:04:30.491543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 111/231] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:30 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:30.661121 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:30.661657 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:30.681670 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:30.682096 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:30.682953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:30.683433 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:30.918685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-1097afc8-0fb1-4139-8e4d-25db9f5be302 req-0cd56b4c-185d-4f7a-b3ce-5682d7ec8994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90e416c8-8886-482e-8f52-bbda52dbf824", "tag": "a8872dc1-8f95-4eaf-862c-38cedddd9d51"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:30.923254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:30.923254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:04:30.943543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-1097afc8-0fb1-4139-8e4d-25db9f5be302 req-0cd56b4c-185d-4f7a-b3ce-5682d7ec8994 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:30.945421 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-1097afc8-0fb1-4139-8e4d-25db9f5be302 req-0cd56b4c-185d-4f7a-b3ce-5682d7ec8994 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:30.996232 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-1097afc8-0fb1-4139-8e4d-25db9f5be302 req-0cd56b4c-185d-4f7a-b3ce-5682d7ec8994 service nova] Creating event network-changed:a8872dc1-8f95-4eaf-862c-38cedddd9d51 for instance 90e416c8-8886-482e-8f52-bbda52dbf824 on hv-cinder-82808 Feb 15 03:04:31.020685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-1097afc8-0fb1-4139-8e4d-25db9f5be302 req-0cd56b4c-185d-4f7a-b3ce-5682d7ec8994 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107749 Feb 15 03:04:31.021316 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 112/232] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:04:31.041806 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:31.043102 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:31.058312 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:31.065258 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:31.066419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:31.067247 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:31.114914 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lazy-loading 'flavor' on Instance uuid c947da6f-4d8e-46ce-8eba-63c9f3093204 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:04:31.422615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:31.440521 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5c3ec3c4-6b01-48c1-8b97-0d90dc8d1d0f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.780249 Feb 15 03:04:31.442887 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 121/233] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:30 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:31.444644 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3bfc1da8-c772-423d-9755-0bdfff89df53 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action" status: 200 len: 32 microversion: 2.1 time: 0.409950 Feb 15 03:04:31.453381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 113/234] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:04:31 2022] POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 03:04:31.457009 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:31.457795 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:31.471242 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:31.472211 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:31.473716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:31.474619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:31.524734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:31.527770 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:31.547782 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:31.548909 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:31.550973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:31.551837 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:31.964961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:31.986384 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:32.004786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:32.006267 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5a3861e9-b880-43a9-a6be-889d2d1a046a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.494618 Feb 15 03:04:32.008052 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 114/235] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:31 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:32.165046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:32.175878 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-aa552fcc-4f98-4ecd-90b1-bcd17b1f1ca2 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.722975 Feb 15 03:04:32.177184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 122/236] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:31 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:32.473460 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:32.477058 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:32.492707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:32.500028 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:32.501134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:32.501776 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:32.806301 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:32.815802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9529aab0-0f01-4ef0-b011-261abb928a12 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.354147 Feb 15 03:04:32.818690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 115/237] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:32 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:33.045722 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:33.048019 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:33.061516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:33.063362 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:33.065258 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:33.066416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:33.194331 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:33.194960 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:33.215257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:33.216122 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:33.217214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:33.226407 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:33.353774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:33.385576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:33.387177 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:33.388407 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-447882ea-ba71-4a8b-97e9-93c9bbb49c0e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.362017 Feb 15 03:04:33.388976 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 123/238] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:33 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:33.479294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:33.494857 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-01e3cb11-9804-4bb7-b9f6-ac4807dc796d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.304723 Feb 15 03:04:33.496148 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 116/239] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:33 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:33.833086 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:33.833710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:33.846279 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:33.847328 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:33.848444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:33.849134 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:34.081445 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:34.094789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2835ffe9-60ad-40b3-8f48-4b8302e13908 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.265068 Feb 15 03:04:34.096119 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 124/240] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:33 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:34.413341 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:34.414380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:34.421268 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:34.422105 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:34.423663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:34.424492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:34.516570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:34.517985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:34.532886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:34.533274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:34.534095 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:34.534540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:34.643216 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:34.662130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:34.664011 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:34.665573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cf14e58f-9eba-440a-a8da-ad111b5b475b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.256163 Feb 15 03:04:34.668394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 117/241] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:34 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:34.827839 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:34.884446 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c55486e1-f0a1-4816-9f9f-cfd600948aa0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.360250 Feb 15 03:04:34.885773 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 125/242] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:34 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:35.039945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-01690cf9-73bf-45a6-a92c-9b0e7fb5bd2f req-4851536c-77a2-4528-a913-5393243b707a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "name": "network-vif-plugged", "status": "completed", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:35.044058 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:35.044058 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:04:35.059466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-01690cf9-73bf-45a6-a92c-9b0e7fb5bd2f req-4851536c-77a2-4528-a913-5393243b707a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.060291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-01690cf9-73bf-45a6-a92c-9b0e7fb5bd2f req-4851536c-77a2-4528-a913-5393243b707a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.080407 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-01690cf9-73bf-45a6-a92c-9b0e7fb5bd2f req-4851536c-77a2-4528-a913-5393243b707a service nova] Creating event network-vif-plugged:5bc40f19-47a8-4cc5-a5e3-1c35392b5b48 for instance 73cd6519-d67b-4635-af86-336ae2fde18b on hv-cinder-82808 Feb 15 03:04:35.097534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-01690cf9-73bf-45a6-a92c-9b0e7fb5bd2f req-4851536c-77a2-4528-a913-5393243b707a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064678 Feb 15 03:04:35.099620 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 118/243] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:04:35.136125 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:35.137561 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:35.175546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.176147 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.177303 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.177985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.388661 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:35.397747 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dd6bab37-8706-404d-b96c-73724a1524e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.274655 Feb 15 03:04:35.398636 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 126/244] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:35 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:35.687679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:35.689202 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:35.698136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.699074 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.700323 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.701204 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.904567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:35.908469 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:35.935545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.939318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:35.948110 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.949765 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:35.950397 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:35.955285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:35.957613 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:35.959043 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-092a3297-25b4-41b9-80f1-78c9270b31dd tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.276891 Feb 15 03:04:35.963803 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 119/245] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:35 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:36.305848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:36.324336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fa956fd9-1051-4888-9e86-1e4fe57b3325 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.426191 Feb 15 03:04:36.325669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 127/246] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:35 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:36.419222 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:36.421134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:36.433855 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:36.435243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:36.437572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:36.438446 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:36.672480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:36.689567 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3ecb308e-e38b-46b5-ac07-d893e85f98d3 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.270456 Feb 15 03:04:36.692869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 120/247] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:36 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:36.989745 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:36.991053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:37.003448 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:37.004874 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:37.006693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:37.007867 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:37.270213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:37.278970 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:37.282035 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:37.283881 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-594d9a50-817c-4a8a-ba63-03fc9240ef5d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.304069 Feb 15 03:04:37.284641 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 128/248] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:36 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:37.355402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:37.356443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:37.368049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:37.368890 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:37.369986 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:37.370435 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:37.580572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:37.599234 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-41ee3151-d8f0-4301-a3de-51484aba25c0 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.247398 Feb 15 03:04:37.609188 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 121/249] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:37 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:37.700004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:37.706982 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:37.724835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:37.727849 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:37.728792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:37.729239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:37.941212 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:37.949346 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ed413c08-d069-4dbe-8252-914c5e719b22 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.253217 Feb 15 03:04:37.961509 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 129/250] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:37 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:38.018891 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-fedaa5a1-1c88-4fb1-8dfd-cae759cdc6fe req-4c7734b3-6e1d-4a60-9c2f-48dc398f15e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e416c8-8886-482e-8f52-bbda52dbf824", "name": "network-vif-plugged", "status": "completed", "tag": "a8872dc1-8f95-4eaf-862c-38cedddd9d51"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:38.020685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:38.020685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:04:38.037827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-fedaa5a1-1c88-4fb1-8dfd-cae759cdc6fe req-4c7734b3-6e1d-4a60-9c2f-48dc398f15e5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:38.038746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-fedaa5a1-1c88-4fb1-8dfd-cae759cdc6fe req-4c7734b3-6e1d-4a60-9c2f-48dc398f15e5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:38.058037 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-fedaa5a1-1c88-4fb1-8dfd-cae759cdc6fe req-4c7734b3-6e1d-4a60-9c2f-48dc398f15e5 service nova] Creating event network-vif-plugged:a8872dc1-8f95-4eaf-862c-38cedddd9d51 for instance 90e416c8-8886-482e-8f52-bbda52dbf824 on hv-cinder-82808 Feb 15 03:04:38.065953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-fedaa5a1-1c88-4fb1-8dfd-cae759cdc6fe req-4c7734b3-6e1d-4a60-9c2f-48dc398f15e5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051574 Feb 15 03:04:38.067558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 122/251] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:04:38.304409 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:38.305758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:38.314319 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:38.315056 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:38.316136 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:38.316750 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:38.645589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:38.648437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:38.698425 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:38.699706 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:38.701665 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:38.702982 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:38.717168 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:38.780022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:38.784547 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:38.787073 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cb902b1e-8f8f-436a-ac07-c4bf529e59be tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.486426 Feb 15 03:04:38.789992 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 130/252] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:38 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:38.948258 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:38.968777 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a239a9c3-c86f-4c9c-bc6b-032958317319 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.342998 Feb 15 03:04:38.968777 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 123/253] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:38 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:38.983494 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:38.984594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:38.999052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:38.999892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:39.001198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:39.001925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:39.247917 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:39.268911 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-df7ce482-a2a3-4a97-b083-a14296f613c4 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1319 microversion: 2.1 time: 0.303212 Feb 15 03:04:39.272638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 131/254] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:38 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:39.808912 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:39.809532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:39.816861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:39.817313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:39.818310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:39.818749 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:40.004032 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:40.008221 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:40.017004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:40.018652 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:40.019809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:40.020469 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:40.038469 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:40.050486 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:40.052874 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:40.056035 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-82a6dc55-4ddc-492f-8b91-eef2e4a712a3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.252910 Feb 15 03:04:40.056666 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 124/255] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:39 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:40.242661 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:40.252829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8f85382e-1ff5-45d7-894a-8f21f164e9a6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.257234 Feb 15 03:04:40.254094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 132/256] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:39 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:40.291711 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:40.293435 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:40.304108 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:40.304454 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:40.305341 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:40.305991 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:40.507748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:40.517557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e33ad0bf-e3af-4f96-8bc9-f2cd4bb338e5 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1509 microversion: 2.1 time: 0.230205 Feb 15 03:04:40.525620 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 125/257] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:40 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:41.076726 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:41.077843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:41.085441 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:41.086233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:41.087306 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:41.087974 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:41.283203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:41.284726 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:41.285516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:41.293991 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:41.294538 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:41.296245 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:41.297276 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:41.302398 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:41.305340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:41.307450 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-eea88fc7-9bd6-4454-88cc-d4e9125a78b0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.235448 Feb 15 03:04:41.308769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 133/258] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:41 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:41.527083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:41.536375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a7085c1e-3013-4be7-a0e9-09cc8d50bfbc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.258232 Feb 15 03:04:41.537278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 126/259] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:41 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:42.336311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:42.339311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:42.350691 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:42.351531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:42.352563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:42.353405 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:42.564035 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:42.568312 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:42.570116 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:42.581791 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:42.584343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:42.585100 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:42.585895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:42.586342 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7d967d31-684f-4d9b-a1dc-c4b327131049 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.260466 Feb 15 03:04:42.588133 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:42.589272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 134/260] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:42 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:42.589551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:42.871491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:42.890255 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-205e5195-5ff3-4011-8823-f05e618a1cec tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.335918 Feb 15 03:04:42.909259 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 127/261] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:42 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:43.612095 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:43.615485 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:43.631099 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:43.631654 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:43.632525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:43.633068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:43.855289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:43.865638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:43.867412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:43.868638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f9545d6f-8b4c-44eb-abd8-6df69b72851c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1738 microversion: 2.20 time: 0.265896 Feb 15 03:04:43.869257 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 135/262] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:43 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:43.916755 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:43.918143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:43.929444 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:43.930424 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:43.932884 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:43.933773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:44.180126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:44.188716 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-be4904e2-cbd5-48ff-acaa-65c693126a20 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.284079 Feb 15 03:04:44.189932 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 128/263] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:43 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:44.899027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:44.899943 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:44.908237 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:44.909063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:44.910234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:44.910911 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:45.116590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:45.126625 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:45.128396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:45.129678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d067da7c-dc2e-48cb-9939-6ab41d9ea75a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1720 microversion: 2.20 time: 0.235615 Feb 15 03:04:45.130282 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 136/264] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:44 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:45.220012 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:45.221361 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:45.229451 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:45.229895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:45.230733 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:45.231190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:45.450978 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:45.460554 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-98cb0d6d-a66f-44b2-9074-e577b9360807 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.246838 Feb 15 03:04:45.461152 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 129/265] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:45 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:45.954939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-52174646", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:46.011923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] validate_networks() for None {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:04:46.152715 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:46.154414 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:46.170377 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:46.171537 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:46.173066 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:46.173853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:46.370908 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:04:46.371628 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:04:46.372240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:04:46.372746 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:04:46.373279 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:04:46.389448 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:46.390193 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:46.391179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:46.391550 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:46.392284 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:46.400602 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:46.402203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:46.403449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-87767904-85fb-408c-8c2a-65f1a13cff7d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1720 microversion: 2.20 time: 0.257711 Feb 15 03:04:46.404031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 130/266] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:46 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:46.410881 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Getting quotas for project 4a49ca330f0a4a50be97f7a7edc88b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:04:46.415845 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Getting quotas for user 9c2ecc297357496bad01689bd5620eb9 and project 4a49ca330f0a4a50be97f7a7edc88b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:04:46.429864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:04:46.432331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:04:46.478229 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:46.480260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:46.486935 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:46.487525 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:46.488423 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:46.489151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:46.493232 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8c7a2404-714f-4661-9c85-98b9b026dd69 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542401 Feb 15 03:04:46.493892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 137/267] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:04:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:04:46.506772 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-328ea95a-e089-43b2-a36f-6149369182fe tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:46.507670 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-328ea95a-e089-43b2-a36f-6149369182fe tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:46.589062 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-328ea95a-e089-43b2-a36f-6149369182fe tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:46.597534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-328ea95a-e089-43b2-a36f-6149369182fe tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1213 microversion: 2.1 time: 0.094362 Feb 15 03:04:46.598214 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 138/268] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:46 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:46.667365 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:46.679563 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-69f79363-97ba-4807-9bb0-5d57746cdfe4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.204325 Feb 15 03:04:46.680217 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 131/269] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:46 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:47.423472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:47.424115 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:47.430927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.431426 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.432231 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.432663 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.604164 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:47.616735 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:47.617627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:47.619583 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:47.620216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:47.622216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-97316455-034c-4536-b444-7b9fc7cce832 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1723 microversion: 2.20 time: 0.202335 Feb 15 03:04:47.623513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 139/270] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:47 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:47.629863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.630606 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.632003 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.632550 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.648458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af525c90-45eb-445f-893d-43625df9e52c"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:47.650067 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:47.662557 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.663544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.665298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.666175 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.709303 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:47.724117 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ecef125d-c4b6-437a-8be9-2a07b6bbbb5e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1265 microversion: 2.1 time: 0.111938 Feb 15 03:04:47.727304 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 132/271] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:47 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:47.745455 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:47.747272 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:47.756196 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.757038 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:47.757880 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:47.758348 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.066676 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:48.076540 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-188a77e9-bdbe-43d3-8385-b5588b2b4732 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.347008 Feb 15 03:04:48.078506 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 133/272] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:47 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:48.091622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-89910c68-e091-4902-8e99-29c1dbdf157b req-54eb63b4-9e9c-4d3a-948b-56156b410e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "name": "network-vif-unplugged", "status": "completed", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:48.091622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:48.091622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:04:48.093523 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-89910c68-e091-4902-8e99-29c1dbdf157b req-54eb63b4-9e9c-4d3a-948b-56156b410e58 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.093979 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-89910c68-e091-4902-8e99-29c1dbdf157b req-54eb63b4-9e9c-4d3a-948b-56156b410e58 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.125342 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.compute.server_external_events [req-89910c68-e091-4902-8e99-29c1dbdf157b req-54eb63b4-9e9c-4d3a-948b-56156b410e58 service nova] Unable to find a host for instance 73cd6519-d67b-4635-af86-336ae2fde18b. Dropping event network-vif-unplugged {{(pid=116501) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 15 03:04:48.126444 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-89910c68-e091-4902-8e99-29c1dbdf157b req-54eb63b4-9e9c-4d3a-948b-56156b410e58 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046844 Feb 15 03:04:48.127063 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 134/273] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 15 03:04:48.135073 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1004889088", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-385441723", "security_groups": [{"name": "tempest-secgroup-smoke-2035710061"}], "networks": [{"uuid": "ca063969-9c0b-40c8-b2ed-bd1316947954"}], "block_device_mapping_v2": [{"uuid": "87c2bbd1-2573-4d22-8054-80a72d20540c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:48.200713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ee30764e-b7a3-47e6-9e0f-9cb7d47ec265 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.556433 Feb 15 03:04:48.201599 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 140/274] 10.222.0.24 () {62 vars in 1363 bytes} [Tue Feb 15 03:04:47 2022] POST /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments => generated 188 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 03:04:48.306254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] validate_networks() for [('ca063969-9c0b-40c8-b2ed-bd1316947954', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:04:48.368995 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:48.370250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:48.378892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.379809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.380861 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.381303 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.561219 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-496031ba-e2d3-4f3b-a01a-5b21beb84614 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/action" status: 202 len: 0 microversion: 2.20 time: 0.196590 Feb 15 03:04:48.566831 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 141/275] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Feb 15 03:04:48 2022] POST /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 15 03:04:48.574835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:48.576004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:48.590220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.591017 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.593422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.595010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.939537 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:04:48.940722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:04:48.941290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:04:48.941972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:04:48.942383 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:04:48.953335 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.954205 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.955241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:48.955920 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:48.979188 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Getting quotas for project 21443331469a45f5b7d064a7f4513743. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:04:48.987075 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Getting quotas for user b7950ed98cda4e27912a90c765e65930 and project 21443331469a45f5b7d064a7f4513743. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:04:49.011845 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:49.027572 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:49.030337 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:49.032417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4b749889-d510-4dee-b51f-71d2dd884085 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1749 microversion: 2.20 time: 0.463795 Feb 15 03:04:49.033792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 142/276] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:48 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1749 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:49.040308 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:49.041292 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:49.081743 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:49.082363 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:49.084063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:49.084811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:49.091262 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:04:49.094187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87c2bbd1-2573-4d22-8054-80a72d20540c',volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:04:49.232014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:49.244082 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9b7ae057-e70c-415e-b8d5-9cf329f1d16b tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1271 microversion: 2.1 time: 0.208425 Feb 15 03:04:49.244734 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 143/277] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:49 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:49.252165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:49.252864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:49.260403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:49.260997 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:49.262591 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:49.263140 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:49.311504 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d601968f-4787-49ec-b083-e0189be97272 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.182767 Feb 15 03:04:49.312841 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 135/278] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:04:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:04:49.324927 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5daf562f-e2a3-43d5-9e76-67e25fc9e62f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:49.325597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5daf562f-e2a3-43d5-9e76-67e25fc9e62f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:49.406764 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5daf562f-e2a3-43d5-9e76-67e25fc9e62f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:49.417441 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5daf562f-e2a3-43d5-9e76-67e25fc9e62f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1088 microversion: 2.1 time: 0.096807 Feb 15 03:04:49.418324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 136/279] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:49 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:49.648417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:49.658508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-09dfba95-76df-4b4c-83e9-8f3e7e5af533 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.411099 Feb 15 03:04:49.659104 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 144/280] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:49 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:50.056596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:50.057917 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:50.098182 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.099638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.101305 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.102574 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.273576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:50.274695 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:50.292531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.293163 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.294283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.300250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.453142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:50.465799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:50.469586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:50.471308 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ab50bc5c-ba85-4d59-b55c-9f6f17347a7c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1749 microversion: 2.20 time: 0.421399 Feb 15 03:04:50.471887 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 137/281] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:50 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1749 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:50.490789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:50.492202 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:50.503885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.506094 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.507459 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.509603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.587022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:50.597669 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-89ca8c65-6460-428e-b79f-b032bc4e883d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1186 microversion: 2.1 time: 0.123476 Feb 15 03:04:50.600481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 138/282] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:50 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1186 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:50.676650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:50.677577 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:50.684990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.686600 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.706778 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.707535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.754610 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:50.762547 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-016a37b4-556b-4649-a05f-de11b8c83d57 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.495461 Feb 15 03:04:50.772226 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 145/283] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:50 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:50.889854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-e9769457-d36c-4645-a59e-6618fb06df4f req-021bd19f-f451-4e2a-b75e-a28f4e155848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb12bf20-aec9-49e6-9cc6-6342b801b644", "tag": "f088e1b9-d291-47ec-8597-6639b900d802"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:50.891323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:50.891323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:04:50.905834 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e9769457-d36c-4645-a59e-6618fb06df4f req-021bd19f-f451-4e2a-b75e-a28f4e155848 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:50.906277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e9769457-d36c-4645-a59e-6618fb06df4f req-021bd19f-f451-4e2a-b75e-a28f4e155848 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:50.941571 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-e9769457-d36c-4645-a59e-6618fb06df4f req-021bd19f-f451-4e2a-b75e-a28f4e155848 service nova] Creating event network-changed:f088e1b9-d291-47ec-8597-6639b900d802 for instance cb12bf20-aec9-49e6-9cc6-6342b801b644 on hv-cinder-82808 Feb 15 03:04:50.948518 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-e9769457-d36c-4645-a59e-6618fb06df4f req-021bd19f-f451-4e2a-b75e-a28f4e155848 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062854 Feb 15 03:04:50.949399 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 146/284] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:04:50.971946 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:50.988712 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fbd2919b-4056-4328-b1ab-b5ceb20b4e1d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.315727 Feb 15 03:04:50.989510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 139/285] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:50 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:51.510334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:51.511805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:51.525659 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:51.526243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:51.527334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:51.528100 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:51.634554 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:51.636008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:51.645242 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:51.646151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:51.647313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:51.647690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:51.730429 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:51.740398 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-da371c5e-3511-4136-b187-37462126c7cd tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1204 microversion: 2.1 time: 0.118290 Feb 15 03:04:51.741623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 140/286] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:51 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1204 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:51.780158 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:51.781118 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:51.792934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:51.794616 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:51.796375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:51.796844 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:52.003004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:52.023044 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:52.027213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:52.030550 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e7ad5adf-8057-48bd-b850-7301fe79f961 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1751 microversion: 2.20 time: 0.526752 Feb 15 03:04:52.031693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 147/287] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:51 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1751 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:52.041674 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:52.043462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:52.055300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:52.056233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:52.057677 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:52.058468 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:52.081791 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:52.097563 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-89802b49-b267-4172-b4c3-d1bf5d5ebd86 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.320911 Feb 15 03:04:52.098739 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 141/288] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:51 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:52.538925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:52.565625 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fb95ce47-0f36-4e6a-ba3e-58b368ea8cbd tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.531844 Feb 15 03:04:52.566629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 148/289] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:52 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:52.768695 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:52.769551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:52.784504 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:52.786005 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:52.787303 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:52.788289 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.058913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:53.060560 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:53.069546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:53.070653 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.071986 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:53.072712 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.149077 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:53.161289 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-6573dd95-66e2-4a2f-81aa-8eb5918998a8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.403318 Feb 15 03:04:53.162357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 142/290] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:52 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:53.171630 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:53.173318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:53.187541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:53.188256 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.189103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:53.189559 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.626763 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:53.641199 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:53.643392 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:53.645077 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e25eab19-818c-4bb4-98fc-9e3592cd08ce tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.597105 Feb 15 03:04:53.645672 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 149/291] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:53 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:53.652935 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:53.654163 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:53.663616 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:53.664321 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.666272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:53.668099 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:53.747359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:53.755469 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3d9267bd-916a-4d49-b452-ef0157dc8595 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.591007 Feb 15 03:04:53.756063 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 143/292] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:53 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:54.110150 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:54.126801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-be77750a-6def-4131-a3ae-1853ee0fae8c tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.479190 Feb 15 03:04:54.127696 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 150/293] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:53 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:54.183412 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:54.184136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:54.229903 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.231086 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.232681 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.234762 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.514620 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:54.523412 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5a067243-c127-4c42-8883-33d350cc2b87 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.346694 Feb 15 03:04:54.524740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 144/294] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:54 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:54.629711 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-29bf2e60-6f4f-4270-bbc3-6831b362ef8f req-d3e0f97d-1e9b-4b86-9b81-f862af589f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:54.634444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:54.634444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:04:54.648739 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-29bf2e60-6f4f-4270-bbc3-6831b362ef8f req-d3e0f97d-1e9b-4b86-9b81-f862af589f95 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.649257 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-29bf2e60-6f4f-4270-bbc3-6831b362ef8f req-d3e0f97d-1e9b-4b86-9b81-f862af589f95 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.663789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-29bf2e60-6f4f-4270-bbc3-6831b362ef8f req-d3e0f97d-1e9b-4b86-9b81-f862af589f95 service nova] Creating event network-changed:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:04:54.669929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-29bf2e60-6f4f-4270-bbc3-6831b362ef8f req-d3e0f97d-1e9b-4b86-9b81-f862af589f95 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059669 Feb 15 03:04:54.671691 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 151/295] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:04:54.680494 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:54.681604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:54.694576 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.697739 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.699966 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.700846 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.783560 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:54.784276 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:54.805919 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.809329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.811866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:54.813751 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:54.996099 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:55.014025 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:55.019357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:55.020876 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3b7e5ac3-d82b-42ca-9864-6d000655d7a9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.349396 Feb 15 03:04:55.022016 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 145/296] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:54 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:04:55.157468 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:55.158438 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:55.179094 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:55.189663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:55.194300 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:55.195382 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:55.290991 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:55.314159 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2abe72e6-9aac-4702-bb01-dd0b85c9e2d0 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.536272 Feb 15 03:04:55.316429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 152/297] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:54 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:55.542231 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:55.543447 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:55.557199 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:55.558220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:55.559529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:55.566384 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:55.611128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:55.637964 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-dacaf206-31f5-4d9d-a1d8-046458b76ffe tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.487216 Feb 15 03:04:55.640425 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 146/298] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:55 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:55.907311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:55.933676 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-60208aa7-c910-4a26-b9b7-136bbe001358 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.393599 Feb 15 03:04:55.939638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 153/299] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:55 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:56.053203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:56.054155 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:56.060812 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.061298 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.062114 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.062557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.346311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:56.347986 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:56.356891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.357390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.359298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.359866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.408198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:56.430480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:56.434569 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:56.438139 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5c8ee9aa-bbdd-4126-9f3a-976bc6786a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.387587 Feb 15 03:04:56.443295 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 147/300] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:56 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:56.571345 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:56.596422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f3f0c746-27f9-4b4b-9972-90eb05dc1dbf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.254212 Feb 15 03:04:56.596422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 154/301] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:56 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:56.666680 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:56.668077 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:56.687375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.688042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.688919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.689375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.901029 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:56.910472 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-980f6ec6-5ef6-4943-b055-468044bc2e7b tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.248459 Feb 15 03:04:56.911773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 148/302] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:56 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:56.962203 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:56.963395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:56.975511 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.976756 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:56.978512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:56.979327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:57.210940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:57.231360 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6a3ab43e-f704-414b-ac98-769d8eb41892 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.275842 Feb 15 03:04:57.232757 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 155/303] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:56 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:57.466486 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:57.467806 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:57.474315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:57.474758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:57.475573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:57.476068 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:57.645702 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:57.646828 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:57.665385 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:57.666158 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:57.667836 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:57.668608 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:57.684869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:57.721874 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:57.723532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:57.725981 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9cc18b69-e18f-4235-a594-55f8caf1e4e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.262929 Feb 15 03:04:57.727656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 149/304] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:57 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:57.918761 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:57.927751 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ac3256a6-241b-4ba6-a294-5bcbc7e3c0eb tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.301656 Feb 15 03:04:57.928458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 156/305] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:57 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:04:57.945576 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:57.946219 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:57.953324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:57.953788 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:57.954611 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:57.955049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.078483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-00f93dd0-b8a3-4748-a0b3-81bbb0bd5c11 req-d77d907f-eb84-4e6d-bb5d-913d7819c85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb12bf20-aec9-49e6-9cc6-6342b801b644", "name": "network-vif-plugged", "status": "completed", "tag": "f088e1b9-d291-47ec-8597-6639b900d802"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:04:58.080606 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:04:58.080606 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:04:58.090502 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-00f93dd0-b8a3-4748-a0b3-81bbb0bd5c11 req-d77d907f-eb84-4e6d-bb5d-913d7819c85a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.090953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-00f93dd0-b8a3-4748-a0b3-81bbb0bd5c11 req-d77d907f-eb84-4e6d-bb5d-913d7819c85a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.109025 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-00f93dd0-b8a3-4748-a0b3-81bbb0bd5c11 req-d77d907f-eb84-4e6d-bb5d-913d7819c85a service nova] Creating event network-vif-plugged:f088e1b9-d291-47ec-8597-6639b900d802 for instance cb12bf20-aec9-49e6-9cc6-6342b801b644 on hv-cinder-82808 Feb 15 03:04:58.116431 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-00f93dd0-b8a3-4748-a0b3-81bbb0bd5c11 req-d77d907f-eb84-4e6d-bb5d-913d7819c85a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041143 Feb 15 03:04:58.127876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 157/306] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:04:58.147059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:58.156840 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7f008cc9-03de-4986-a05e-41ddce06efa9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.215662 Feb 15 03:04:58.158010 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 150/307] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:57 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:58.258148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:58.258760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:58.266772 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.267252 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.268159 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.268584 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.451447 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:58.462492 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cf38f76d-0785-4ed3-b221-bdb5ed4e0829 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.208777 Feb 15 03:04:58.463563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 158/308] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:58 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:58.750663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:58.751351 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:58.758629 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.759089 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.759959 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.760434 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.922639 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:58.932016 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:58.933730 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:58.935006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8b4075a3-703f-4af2-b1d3-c9b664c6b382 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.188867 Feb 15 03:04:58.935718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 151/309] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:58 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:04:58.946457 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:58.948095 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:58.958811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.959969 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:58.961496 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:58.962394 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:59.174532 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:59.185758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3e09575f-39fd-4b84-980c-675b2319da18 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.243629 Feb 15 03:04:59.186791 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 159/310] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:58 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:59.192163 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:59.193608 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:59.203636 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:59.204403 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:59.205436 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:59.206214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:59.419509 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:59.431890 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8b18c1cd-1f5a-4d94-bd62-ebc9b769d7e9 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.246291 Feb 15 03:04:59.432641 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 152/311] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:59 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:59.485876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:59.487552 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:59.497850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:59.498937 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:59.499823 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:59.500328 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:59.712967 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:04:59.722196 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-aea92779-4a5a-43ee-9dc2-794335166236 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.243690 Feb 15 03:04:59.722791 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 160/312] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:04:59 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:04:59.955693 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:04:59.957281 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:04:59.965092 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:59.965546 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:04:59.966376 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:04:59.966852 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.178246 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:00.191931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:00.193924 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:00.195618 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b296a9ba-e69e-4f0c-8e78-b68e18542218 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.244438 Feb 15 03:05:00.196748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 153/313] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:04:59 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:00.216424 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:00.218398 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:00.228712 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:00.229171 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.230213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:00.231053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.448307 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:00.455689 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:00.456324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:00.466933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ea8c9ad6-c753-4431-a960-5ab1f7bc7de2 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.266107 Feb 15 03:05:00.468649 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 161/314] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:00 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:00.472453 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:00.472975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.474866 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:00.474866 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.707588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:00.722363 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-74f48b46-15c2-41e0-8d82-a8755b123b82 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.270353 Feb 15 03:05:00.724062 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 154/315] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:00 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:00.750323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:00.751506 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:00.763513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:00.764449 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.765920 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:00.766680 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:00.983542 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:01.007317 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9469617e-bfc1-486e-ba28-f782972bbbd5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.264673 Feb 15 03:05:01.008618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 162/316] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:00 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:01.213788 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:01.214481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:01.222067 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.222624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.223541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.224054 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.338970 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efc93a2b-7e69-411d-8a45-c3dcc139e869", "device": "/dev/sdb"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:01.341458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:01.349302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.349832 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.351113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.351622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.400861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:01.411235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:01.413038 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:01.414372 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4f630bfa-dc4e-4a93-ab6e-1279c11b0df1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.204284 Feb 15 03:05:01.426295 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 155/317] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:01 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:01.497540 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:01.498160 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:01.508829 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.509285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.510088 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.511267 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.704105 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:01.713878 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5c183ec4-92e0-47ae-a2ce-8951c2ff5bf1 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.220072 Feb 15 03:05:01.714476 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 156/318] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:01 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:01.752294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:01.753319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:01.762691 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.763522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.765047 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:01.765827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:01.969291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:01.979683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5a3ff944-1cd1-4d3c-aca4-607a470cfe75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.234761 Feb 15 03:05:01.980542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 157/319] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:01 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:02.030634 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:02.031673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:02.041490 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:02.042714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:02.044380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:02.045183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:02.267599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:02.278724 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e12e5241-70db-43a1-9404-c214232d03d2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.252044 Feb 15 03:05:02.292384 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 158/320] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:02 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:02.434090 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:02.434643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:02.442094 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:02.442552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:02.443405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:02.443881 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:02.701291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:02.711843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:02.715106 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:02.718025 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1157c2f1-ce6c-4875-92f3-07501aa20430 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.287355 Feb 15 03:05:02.719107 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 159/321] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:02 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:02.742924 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:02.744161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:02.757423 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:02.758223 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:02.759707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:02.760438 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:02.964623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:02.973589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-81bc1f05-0503-45b3-84a7-cda647e95c3e tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.237582 Feb 15 03:05:02.974194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 160/322] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:02 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:03.002783 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:03.004503 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:03.018409 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:03.019746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:03.021261 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:03.022055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:03.241422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:03.258284 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-89e8e9ab-d891-465e-b1c4-40702b866f40 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.263310 Feb 15 03:05:03.259625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 161/323] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:02 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:03.311915 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:03.312980 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:03.323492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:03.324005 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:03.325088 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:03.325720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:03.554964 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:03.565612 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1aa2c270-cdde-49b3-a5a8-0cfb7c609a6a tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.262242 Feb 15 03:05:03.566434 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 162/324] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:03 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:03.757308 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:03.758325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:03.774704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:03.774704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:03.774704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:03.774704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:03.998813 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:04.008407 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:04.010145 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:04.011452 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-06e384d4-6e9d-4915-8bb4-b09c40a995b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.262014 Feb 15 03:05:04.025738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 163/325] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:03 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:04.025738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:04.025738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:04.025738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:04.025738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:04.026559 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:04.026559 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:04.239818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:04.255381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f1816d05-38f9-443a-a653-c4616228868f tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.241795 Feb 15 03:05:04.256648 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 164/326] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:04 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:04.282870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:04.283627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:04.290485 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:04.290938 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:04.291875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:04.292353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:04.501312 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:04.515700 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-41b190ef-5785-44e8-a0e5-0e4b5c843969 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.239388 Feb 15 03:05:04.516657 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 165/327] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:04 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:04.583434 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:04.584110 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:04.590512 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:04.590953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:04.591799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:04.592979 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:04.754018 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:04.762371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3c685668-b6db-4b18-8829-f0ed3b6589d0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.182761 Feb 15 03:05:04.762959 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 166/328] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:04 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:05.048957 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:05.050288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:05.060360 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.061961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.063664 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.064578 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.126201 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8e488bd9-9dc9-4cd9-bcb7-50313f3c989d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "POST /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.790707 Feb 15 03:05:05.127217 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 163/329] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:05:01 2022] POST /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824/os-volume_attachments => generated 194 bytes in 3792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:05.282692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:05.283814 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:05.291965 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.292591 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.293712 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.294227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.312187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:05.323588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:05.327743 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:05.329333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8310b670-298b-423d-811e-478ecc27987c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.288973 Feb 15 03:05:05.333231 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 167/330] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:05 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:05.534015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:05.534703 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:05.541182 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.541643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.542449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.542886 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.636630 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:05.645450 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d734c532-5362-4141-908d-85e5fb4a2584 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.367480 Feb 15 03:05:05.646229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 164/331] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:05 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:05.701318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:05.710090 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b3122096-33fe-4635-9d9e-c9f8b1b8ac61 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.180739 Feb 15 03:05:05.710682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 168/332] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:05 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:05.782031 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:05.782657 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:05.788885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.789341 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:05.790148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:05.790593 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.016724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:06.025443 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b5811ff6-47dc-4806-85aa-24b7df287526 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.247956 Feb 15 03:05:06.026197 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 165/333] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:05 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:06.352449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:06.353496 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:06.362475 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:06.363203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.364416 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:06.365161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.591029 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:06.601678 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:06.604273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:06.606415 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1fe4fc54-7534-4705-94a2-65d5b7b14f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.258133 Feb 15 03:05:06.607357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 169/334] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:06 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:06.667396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:06.668434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:06.678870 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:06.679643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.680981 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:06.681710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.736709 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:06.737249 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:06.745805 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:06.746654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.748034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:06.748868 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:06.878437 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:06.887678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-eb6cd205-88dc-4df2-bc38-a1fbad9715c6 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1313 microversion: 2.1 time: 0.226482 Feb 15 03:05:06.889128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 166/335] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:06 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:06.990445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:06.998560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4d4d2f7b-809e-4dcb-aa21-8bae71e5a6a1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1568 microversion: 2.1 time: 0.266287 Feb 15 03:05:06.999135 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 170/336] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:06 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:07.043183 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:07.043800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:07.050285 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:07.050734 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:07.051573 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:07.052018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:07.190027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:07.197460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cd58345f-e608-42f2-8739-8244d97beed8 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.157938 Feb 15 03:05:07.198028 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 167/337] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:07 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:07.628018 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:07.628841 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:07.635795 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:07.636242 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:07.637035 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:07.637470 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:07.791205 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:07.801085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:07.802639 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:07.803949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ae696d26-fdd1-43c1-8af6-6860a1a9cea8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.181561 Feb 15 03:05:07.804522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 171/338] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:07 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:07.915727 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:07.916891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:07.928777 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:07.929532 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:07.930695 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:07.931468 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.026315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.026939 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.033773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.034429 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.035545 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.035985 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.094211 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:08.108603 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9be5cb36-98b5-436f-9483-de84eb9cbb2a tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1463 microversion: 2.1 time: 0.199063 Feb 15 03:05:08.109743 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 168/339] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:07 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1463 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:08.117909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2b2db53-d501-4977-95ae-ede8c753c172"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:08.120342 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.131615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.132670 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.133507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.133949 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.225174 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:08.233196 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-2d691a7a-6b0e-466d-8054-72754da06e16 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1548 microversion: 2.1 time: 0.221287 Feb 15 03:05:08.235663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 172/340] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:08 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:08.238514 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.239116 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.245520 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.245972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.247025 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.247277 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.276254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:05:08.372167 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4360ed07-e6a1-4843-ba93-423b972e0ccf tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "DELETE /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 204 len: 0 microversion: 2.1 time: 0.136959 Feb 15 03:05:08.372932 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 173/341] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:05:08 2022] DELETE /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:05:08.379493 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.380314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.386293 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.386754 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.387827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.388336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.415320 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4fe8b970-54cd-4386-8c31-89f78c1d023c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303984 Feb 15 03:05:08.415940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 169/342] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:05:08 2022] POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:08.422061 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.422893 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.430476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.430983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.431851 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.432508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.566769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:08.574758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-db5ba480-a111-4bbb-a8fd-433961b34288 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.199737 Feb 15 03:05:08.575383 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 174/343] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:08 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:08.580879 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.581980 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.592214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.592915 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.593908 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.594345 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.594470 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] HTTP exception thrown: Cannot 'detach_volume' instance c947da6f-4d8e-46ce-8eba-63c9f3093204 while it is in vm_state rescued Feb 15 03:05:08.595388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Returning 409 to user: Cannot 'detach_volume' instance c947da6f-4d8e-46ce-8eba-63c9f3093204 while it is in vm_state rescued {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:05:08.596936 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c4c23012-9acb-4002-a802-e68ba8b88890 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments/1ef3e0a2-3e59-4a32-90a3-c9cc067c1bf8" status: 409 len: 152 microversion: 2.1 time: 0.179436 Feb 15 03:05:08.597879 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 170/344] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:05:08 2022] DELETE /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments/1ef3e0a2-3e59-4a32-90a3-c9cc067c1bf8 => generated 152 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 15 03:05:08.606738 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:08.607307 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.614036 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.614507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.615320 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.615774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.683754 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ae148513-3c2b-406e-9a8c-79429dbcf504 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action" status: 202 len: 0 microversion: 2.1 time: 0.080914 Feb 15 03:05:08.688087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 171/345] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:05:08 2022] POST /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:05:08.694429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.695429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.703715 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.704216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.706045 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.706533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.755640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:08.763987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-73c73422-fdfe-461e-b6c5-8d4a6ac50366 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1469 microversion: 2.1 time: 0.187325 Feb 15 03:05:08.764821 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 175/346] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:08 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:08.823258 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:08.823875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:08.830022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.830471 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.831287 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:08.831724 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:08.959329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:08.969442 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-492f0a78-c864-4cb7-8500-3f94474bd3c6 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1556 microversion: 2.1 time: 0.279702 Feb 15 03:05:08.970312 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 172/347] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:08 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1556 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:09.013740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:09.023201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:09.024682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:09.025832 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c5e0928f-1e2d-425d-a1c7-c06f02cc03bf tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.206415 Feb 15 03:05:09.026607 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 176/348] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:08 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:09.593040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:09.593704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:09.601016 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:09.601306 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:09.602090 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:09.602527 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:09.758095 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:09.768183 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0621fabc-5816-424a-9445-6a2947aee658 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.179760 Feb 15 03:05:09.768862 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 173/349] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:09 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:09.782222 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:09.782842 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:09.792593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:09.793449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:09.794911 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:09.795761 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:09.943638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:09.953882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b7883673-bdac-4146-8693-d4ce61ba9df5 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1469 microversion: 2.1 time: 0.175282 Feb 15 03:05:09.954481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 177/350] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:09 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:09.987300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:09.987923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:09.993999 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:09.994458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:09.995286 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:09.995729 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.044949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:10.045832 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:10.052070 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.052610 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.053504 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.054128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.136148 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:10.145382 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-377bf50a-3cca-473b-828c-42ec24247c41 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1556 microversion: 2.1 time: 0.161679 Feb 15 03:05:10.146153 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 174/351] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:09 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:10.196954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:10.206613 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:10.208162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:10.209323 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5f4c1032-636c-4281-a723-eefb1a328295 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.168113 Feb 15 03:05:10.210157 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 178/352] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:10 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:10.680626 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-7a0c90b3-f259-4cfb-a2d8-a091a6026b58 req-ab1c5ee7-7b25-4b57-a648-bf4eb6113c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb12bf20-aec9-49e6-9cc6-6342b801b644", "name": "network-vif-deleted", "tag": "f088e1b9-d291-47ec-8597-6639b900d802"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:10.682597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:10.682597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:05:10.692399 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7a0c90b3-f259-4cfb-a2d8-a091a6026b58 req-ab1c5ee7-7b25-4b57-a648-bf4eb6113c27 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.699339 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7a0c90b3-f259-4cfb-a2d8-a091a6026b58 req-ab1c5ee7-7b25-4b57-a648-bf4eb6113c27 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.712494 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-7a0c90b3-f259-4cfb-a2d8-a091a6026b58 req-ab1c5ee7-7b25-4b57-a648-bf4eb6113c27 service nova] Creating event network-vif-deleted:f088e1b9-d291-47ec-8597-6639b900d802 for instance cb12bf20-aec9-49e6-9cc6-6342b801b644 on hv-cinder-82808 Feb 15 03:05:10.718558 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-7a0c90b3-f259-4cfb-a2d8-a091a6026b58 req-ab1c5ee7-7b25-4b57-a648-bf4eb6113c27 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041290 Feb 15 03:05:10.719397 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 175/353] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:10.785314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:10.785935 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:10.792877 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.793822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.794305 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.794781 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.953692 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:10.962039 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b936801d-c9fc-4de5-ba80-c4a0675468e5 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.180490 Feb 15 03:05:10.962652 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 179/354] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:10 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:10.971848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:10.972557 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:10.979473 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.979929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:10.980735 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:10.981218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.020758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.021432 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.021654 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lazy-loading 'fault' on Instance uuid cb12bf20-aec9-49e6-9cc6-6342b801b644 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:05:11.068082 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2ecc297357496bad01689bd5620eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49ca330f0a4a50be97f7a7edc88b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:11.075866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8b843a34-a613-4459-be89-23ae34286964 tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 200 len: 1303 microversion: 2.1 time: 0.108724 Feb 15 03:05:11.076587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 176/355] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:10 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:11.163144 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:11.163788 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:11.171749 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.172302 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.173223 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.173690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.229256 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:11.229875 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:11.237953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.238402 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.239590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.240376 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.347566 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:11.358892 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8fe6b1c2-cafb-4ca3-ab11-0a0d090c3b00 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1556 microversion: 2.1 time: 0.198374 Feb 15 03:05:11.359536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 180/356] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:11 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:11.452511 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:11.469859 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:11.472808 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:11.475132 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ebfb6b55-0603-4104-b656-830d34087df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.251070 Feb 15 03:05:11.476063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 177/357] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:11 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:11.980881 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:11.981937 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:11.991367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.992002 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:11.993023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:11.993685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.096027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:12.096953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] [instance: cb12bf20-aec9-49e6-9cc6-6342b801b644] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:12.107415 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.108904 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.110068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.110778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.128566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] HTTP exception thrown: Instance cb12bf20-aec9-49e6-9cc6-6342b801b644 could not be found. Feb 15 03:05:12.129551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] Returning 404 to user: Instance cb12bf20-aec9-49e6-9cc6-6342b801b644 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:05:12.130955 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c2b3eece-0503-4e81-bf6b-c5d17588faba tempest-VolumesNegativeTest-781281664 tempest-VolumesNegativeTest-781281664-project] 10.222.0.24 "GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644" status: 404 len: 111 microversion: 2.1 time: 0.039884 Feb 15 03:05:12.132207 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 178/358] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:12 2022] GET /compute/v2.1/servers/cb12bf20-aec9-49e6-9cc6-6342b801b644 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:05:12.232811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:12.245642 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-06b5cf54-c311-4ee8-abaa-a20446bb0979 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.268705 Feb 15 03:05:12.246696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 181/359] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:11 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:12.379081 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:12.379946 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:12.386221 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.386694 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.387612 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.388072 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.502832 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:12.503885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:12.510137 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.510588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.511626 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.512339 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.562074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:12.581924 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8231284d-eb4f-452d-aad8-51b9ca059f5f tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1562 microversion: 2.1 time: 0.208121 Feb 15 03:05:12.582749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 179/360] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:12 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1562 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:12.650075 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:12.650281 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:12.667596 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.675669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.680776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:12.680776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:12.687586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:12.698254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:12.701200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:12.703591 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c814d563-3c4d-40d9-924e-137439d1574e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.204973 Feb 15 03:05:12.708264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 182/361] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:12 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:12.792904 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lazy-loading 'services' on Instance uuid c947da6f-4d8e-46ce-8eba-63c9f3093204 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:05:13.117715 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6a89cb51-9b30-4276-8532-6b9d4368cd76 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments/1ef3e0a2-3e59-4a32-90a3-c9cc067c1bf8" status: 202 len: 0 microversion: 2.1 time: 0.471412 Feb 15 03:05:13.121673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 180/362] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:05:12 2022] DELETE /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments/1ef3e0a2-3e59-4a32-90a3-c9cc067c1bf8 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:05:13.129015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:13.130577 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:13.140831 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:13.141362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:13.142726 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:13.143459 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:13.193340 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e96573b8-92ef-4a76-9afc-32f0c1f02376 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069704 Feb 15 03:05:13.194757 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 183/363] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:13 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:13.267661 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:13.268632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:13.278870 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:13.280352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:13.281773 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:13.282496 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:13.482590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:13.499809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6d6da9ab-6976-4d31-b54e-582695690ee2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.237305 Feb 15 03:05:13.500239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 181/364] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:13 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:13.726558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:13.727824 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:13.738367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:13.739302 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:13.741111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:13.741748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:13.915420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:13.926077 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:13.928304 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:13.929753 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3b34822b-152b-440d-b1c7-9594d17cc7ec tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.209532 Feb 15 03:05:13.930326 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 184/365] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:13 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:14.211086 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:14.212496 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:14.222204 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:14.222821 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:14.223804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:14.224252 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:14.262912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-07300c7f-6017-4b7c-b3cf-19b1364e8c5e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057503 Feb 15 03:05:14.263644 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 182/366] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:14 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:14.525403 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:14.526108 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:14.532723 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:14.533258 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:14.534266 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:14.534941 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:14.710573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:14.719836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7ccbccce-9a4e-4332-827c-2bdc4bdbabfe tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.198686 Feb 15 03:05:14.723328 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 185/367] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:14 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:14.957924 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:14.959014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:14.966540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:14.967782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:14.969355 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:14.969886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:15.183815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:15.218323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:15.221413 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:15.223405 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-691a7ad3-d1f3-4280-a535-d25096c61441 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.270890 Feb 15 03:05:15.224172 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 183/368] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:14 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:15.274133 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:15.276937 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:15.283225 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:15.283774 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:15.284635 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:15.285083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:15.323613 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a2a3ce40-9104-4924-8250-09bebf43f25e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053321 Feb 15 03:05:15.324505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 186/369] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:15 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:15.747587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:15.748275 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:15.754868 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:15.755357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:15.756153 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:15.756592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:15.902401 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:15.913127 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-022aa4b9-46b7-40fe-850c-14286fdd4ba0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.169194 Feb 15 03:05:15.913737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 184/370] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:15 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:16.243950 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:16.244585 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:16.257161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:16.264896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:16.264896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:16.264896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:16.337064 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:16.338307 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:16.350717 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:16.351005 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:16.353062 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:16.354928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:16.432392 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8029f388-d8b3-4a52-8361-994d758cda15 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098856 Feb 15 03:05:16.433619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 185/371] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:16 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:16.453542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:16.464347 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:16.466130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:16.468945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-2530d166-089a-4613-b027-b695d17cfc86 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.229073 Feb 15 03:05:16.469797 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 187/372] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:16 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:16.929646 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:16.930513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:16.939003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:16.939695 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:16.940472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:16.940904 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:17.094768 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:17.103839 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-885645f1-253b-4f94-ba03-ef747749e5e6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.177954 Feb 15 03:05:17.104835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 186/373] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:16 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:17.449155 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:17.451750 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:17.463629 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:17.464145 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:17.465419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:17.465973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:17.489489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:17.491526 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:17.498596 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:17.499662 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:17.500794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:17.501416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:17.518934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-55ef0965-bfd2-4800-a1f4-9bb2ac4f123d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076813 Feb 15 03:05:17.520570 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 188/374] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:17 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:17.672654 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:17.683277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:17.685049 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:17.686343 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0e3d6a7a-9340-4cd1-8122-dd3922856ec5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.201013 Feb 15 03:05:17.687065 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 187/375] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:17 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:18.124391 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:18.125040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:18.132117 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:18.132680 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:18.133609 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:18.134052 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:18.293838 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:18.303670 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e68103fc-46a5-490b-948c-869d1c5959b7 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.183778 Feb 15 03:05:18.304526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 189/376] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:18 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:18.535091 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:18.536189 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:18.544113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:18.544592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:18.546615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:18.547177 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:18.581774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-71d5e352-fbe4-4ccc-a454-730de2e70eb1 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051049 Feb 15 03:05:18.582355 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 188/377] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:18 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:18.705813 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:18.706443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:18.713359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:18.713821 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:18.714659 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:18.715105 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:18.909940 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:18.919600 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:18.922166 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:18.923498 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-78856d5f-3113-4028-a7fa-55bc2f16e816 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.221495 Feb 15 03:05:18.924227 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 190/378] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:18 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:19.332280 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:19.332862 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:19.340829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:19.341544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:19.343520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:19.344144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:19.510888 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:19.520866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d75044a8-80a6-472f-b80b-66f5e6becfab tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.193510 Feb 15 03:05:19.521462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 189/379] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:19 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:19.594046 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:19.595533 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:19.603660 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:19.604353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:19.605358 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:19.605883 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:19.641277 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3e144eaa-63c0-40b2-9ee9-872f8ce8b369 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052141 Feb 15 03:05:19.641869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 191/380] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:19 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:19.944082 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:19.944688 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:19.954832 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:19.955570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:19.957168 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:19.957795 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:20.118618 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-f3922573-8a11-45eb-80e8-83f585a1644f req-e7121d37-4a89-4b1a-a77f-e70112932bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "name": "network-vif-plugged", "status": "completed", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:20.121143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:20.121143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:05:20.129447 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-f3922573-8a11-45eb-80e8-83f585a1644f req-e7121d37-4a89-4b1a-a77f-e70112932bfd service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:20.130099 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-f3922573-8a11-45eb-80e8-83f585a1644f req-e7121d37-4a89-4b1a-a77f-e70112932bfd service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:20.134450 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:20.143362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-f3922573-8a11-45eb-80e8-83f585a1644f req-e7121d37-4a89-4b1a-a77f-e70112932bfd service nova] Creating event network-vif-plugged:5bc40f19-47a8-4cc5-a5e3-1c35392b5b48 for instance 73cd6519-d67b-4635-af86-336ae2fde18b on hv-cinder-82808 Feb 15 03:05:20.149022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-f3922573-8a11-45eb-80e8-83f585a1644f req-e7121d37-4a89-4b1a-a77f-e70112932bfd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034397 Feb 15 03:05:20.149728 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 192/381] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:20.158567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:20.165502 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:20.168325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-505d351d-edde-4d8c-ac67-ce63503337c8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.227532 Feb 15 03:05:20.191250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 190/382] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:19 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:20.540666 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:20.541375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:20.547650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:20.548056 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:20.548858 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:20.549301 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:20.656895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:20.658721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:20.668206 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:20.669329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:20.671318 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:20.672062 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:20.718576 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:20.720285 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f10bee7c-6984-4756-9322-6956a3dcb96e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071160 Feb 15 03:05:20.721365 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 191/383] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:20 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:20.735454 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-55a91aab-1d9d-4fa9-b60e-91bb0cc8d199 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.198582 Feb 15 03:05:20.736162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 193/384] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:20 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:21.202411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:21.203683 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:21.215181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.215840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.219580 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.220466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.369789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-96932536-d50a-48b5-bf83-c2b364bdeda2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:21.377672 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-96932536-d50a-48b5-bf83-c2b364bdeda2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.378147 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-96932536-d50a-48b5-bf83-c2b364bdeda2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.410010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:21.419985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:21.421587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:21.422790 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-18934d2e-f0b5-4407-8c2f-9f96c585281e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.228839 Feb 15 03:05:21.423437 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 192/385] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:21 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:21.444916 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-96932536-d50a-48b5-bf83-c2b364bdeda2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Going to try to stop instance {{(pid=116501) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 15 03:05:21.496817 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-96932536-d50a-48b5-bf83-c2b364bdeda2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action" status: 202 len: 0 microversion: 2.1 time: 0.130888 Feb 15 03:05:21.497550 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 194/386] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:05:21 2022] POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:05:21.506401 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:21.507046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:21.513409 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.514394 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.515416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.515859 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.669708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:21.679390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b5172d28-0506-4384-8c71-0f23d8cb83a2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.176664 Feb 15 03:05:21.680013 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 193/387] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:21 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:21.733769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:21.734783 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:21.742147 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.742768 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.743654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.744329 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.752973 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:21.753705 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:21.759879 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.760357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.761251 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:21.761696 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:21.783111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bdfaa82a-3b3b-4d54-85d9-b352152f6d34 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054133 Feb 15 03:05:21.783882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 195/388] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:21 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:21.955089 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:21.966178 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0711f50d-5e95-4015-ad42-8907e91d789f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.216834 Feb 15 03:05:21.967266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 194/389] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:21 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:22.220856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-2189c05d-c3a7-4540-83a5-1fc1e115672e req-530ed4e9-11d8-4d8b-9cd4-fa88e9176d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "name": "network-vif-plugged", "status": "completed", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:22.222479 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:22.222479 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:05:22.229931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-2189c05d-c3a7-4540-83a5-1fc1e115672e req-530ed4e9-11d8-4d8b-9cd4-fa88e9176d15 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.230418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-2189c05d-c3a7-4540-83a5-1fc1e115672e req-530ed4e9-11d8-4d8b-9cd4-fa88e9176d15 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.247031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-2189c05d-c3a7-4540-83a5-1fc1e115672e req-530ed4e9-11d8-4d8b-9cd4-fa88e9176d15 service nova] Creating event network-vif-plugged:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:05:22.252375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-2189c05d-c3a7-4540-83a5-1fc1e115672e req-530ed4e9-11d8-4d8b-9cd4-fa88e9176d15 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038098 Feb 15 03:05:22.252982 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 196/390] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:22.441613 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:22.442533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:22.450493 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.451009 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.452888 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.453597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.608276 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:22.621503 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:22.623984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:22.625320 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-13a83436-9555-45ac-893f-fc361a1d919b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.187693 Feb 15 03:05:22.625900 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 195/391] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:22 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:05:22.698254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:22.698961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:22.706283 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.706772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.707628 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.708052 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.798618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:22.799749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:22.808705 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.809413 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.810716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.811458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.856211 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-980416ea-f602-457b-917f-9b3867ff6832 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062241 Feb 15 03:05:22.856915 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 196/392] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:22 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:22.875132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:22.884154 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8e8bee15-f164-4287-9ba1-4469ebd887fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.190274 Feb 15 03:05:22.884856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 197/393] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:22 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:22.984692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:22.985462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:22.991909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.992354 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:22.993144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:22.993568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.143565 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:23.151295 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8eff348e-fc7e-4f90-8c91-16b4198dacc3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.171488 Feb 15 03:05:23.151901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 197/394] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:22 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:23.644516 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:23.645183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:23.651886 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:23.652346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.653290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:23.653734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.806274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:23.816161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:23.817684 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:23.818889 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-40c15afb-672f-40d5-a5c0-8d0f9ca54245 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.178540 Feb 15 03:05:23.819488 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 198/395] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:23 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:23.869541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:23.870815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:23.880004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:23.880524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.883017 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:23.883649 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.905383 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:23.906201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:23.913677 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:23.914144 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.914942 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:23.915437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:23.919787 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-31852ef5-8d9d-48f8-9cdc-d951a2678906 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053488 Feb 15 03:05:23.920873 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 198/396] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:23 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:24.112090 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:24.122905 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7b91bea2-bfb3-426a-bac1-56eed9e2c49a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.222495 Feb 15 03:05:24.124394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 199/397] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:23 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:24.169748 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:24.171878 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:24.178855 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:24.179441 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:24.180272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:24.180748 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:24.489520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:24.498310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b2f8514e-3cf4-44de-b0c6-e5e21951ac0c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.333608 Feb 15 03:05:24.499085 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 199/398] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:24 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:24.841091 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:24.842081 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:24.851665 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:24.852422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:24.853694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:24.854546 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:24.933047 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:24.934108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:24.950098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:24.952299 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:24.953145 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:24.953595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:24.990245 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c3321e8a-0cb2-4857-9d42-d6edb6c85bcc tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061167 Feb 15 03:05:24.990734 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 200/399] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:05:24 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 15 03:05:25.150498 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:25.151831 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:25.154013 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:25.167540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:25.168100 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:25.172156 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:25.174049 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:25.181904 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:25.184894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:25.188466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-155c185b-af09-4819-9406-c3f5bd20543d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1807 microversion: 2.20 time: 0.351858 Feb 15 03:05:25.190255 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 200/400] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:24 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1807 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:25.387688 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:25.410434 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e122ef36-908b-4339-a358-0f8ad220642f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.267395 Feb 15 03:05:25.411181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 201/401] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:25 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:25.522849 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:25.524250 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:25.534953 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:25.535806 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:25.537233 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:25.537999 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:25.785272 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:25.798250 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f9f5ea6e-ca5f-4bab-b285-2fe5411c23ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1260 microversion: 2.1 time: 0.284140 Feb 15 03:05:25.799725 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 201/402] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:25 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:26.208962 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:26.209643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:26.216242 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:26.216710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:26.220160 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:26.220581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:26.381051 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:26.393690 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:26.395759 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:26.397108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e35aa6e4-f7b0-4797-b235-271adf39c403 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1794 microversion: 2.20 time: 0.191826 Feb 15 03:05:26.398063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 202/403] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:05:26 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1794 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:05:26.436513 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:26.437129 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:26.443948 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:26.444404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:26.445205 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:26.445645 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:26.590141 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:26.599588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-02639b4c-9a46-4268-9ab8-51b781c9b999 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.167078 Feb 15 03:05:26.600171 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 202/404] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:26 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:26.833767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:26.834375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:26.841135 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:26.841495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:26.842794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:26.843438 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:26.998971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:27.006866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-49ef9c3f-16f0-47bf-8d2d-73182d129c71 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1445 microversion: 2.1 time: 0.176705 Feb 15 03:05:27.007495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 203/405] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:26 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1445 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:27.026019 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:27.026640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:27.033934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.034395 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.035342 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.035779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.190034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:27.199555 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-baa05911-6157-408f-92b9-6a0150b87cc9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1445 microversion: 2.1 time: 0.178282 Feb 15 03:05:27.200141 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 203/406] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:27 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1445 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:27.465274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:27.466308 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:27.480660 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.481595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.484453 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.485250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.542289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:05:27.617345 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:27.618501 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:27.625122 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.626079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.626923 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.627394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.666727 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cecb5696-c875-420e-abd9-6d8fca843027 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 204 len: 0 microversion: 2.1 time: 0.208509 Feb 15 03:05:27.667390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 204/407] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:05:27 2022] DELETE /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 03:05:27.676624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:27.677347 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:27.683964 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.684503 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.685235 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:27.686284 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:27.866876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:27.877814 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ff5181ca-83b1-4246-a86c-d4e3c63953ed tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1509 microversion: 2.1 time: 0.205040 Feb 15 03:05:27.879460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 205/408] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:27 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:27.909257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:27.917646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7e4d204b-80b9-48bd-a23f-add969afed26 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.304274 Feb 15 03:05:27.918132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 204/409] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:27 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:28.335583 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:28.336194 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:28.343665 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:28.344300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:28.345170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:28.345684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:28.461086 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lazy-loading 'services' on Instance uuid 90e416c8-8886-482e-8f52-bbda52dbf824 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:05:28.576059 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-806b004f-9fd7-44c8-aacd-1b7c37cbbc0a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "DELETE /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824/os-volume_attachments/efc93a2b-7e69-411d-8a45-c3dcc139e869" status: 202 len: 0 microversion: 2.1 time: 0.244961 Feb 15 03:05:28.580939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 206/410] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:05:28 2022] DELETE /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824/os-volume_attachments/efc93a2b-7e69-411d-8a45-c3dcc139e869 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:05:28.905588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:28.906625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:28.914420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:28.915192 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:28.916557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:28.917138 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:28.958519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:28.960258 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:28.973802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:28.974348 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:28.975374 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:28.975796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:29.135432 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:29.144014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b4c46fdc-dc89-4fdb-9150-aef03f23a36e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.197571 Feb 15 03:05:29.144755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 207/411] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:28 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:29.174995 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:29.185861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-503ee23f-2ae8-4bbe-a2d7-8d470ceb98fb tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1509 microversion: 2.1 time: 0.284732 Feb 15 03:05:29.186856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 205/412] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:28 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:29.730185 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:29.730927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:29.738156 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:29.738693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:29.739510 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:29.739941 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:29.766989 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:05:29.870150 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-625164c4-46d2-474d-83b6-6530ac42cf34 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "DELETE /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 204 len: 0 microversion: 2.1 time: 0.143222 Feb 15 03:05:29.870771 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 208/413] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:05:29 2022] DELETE /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 03:05:29.881569 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:29.882708 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:29.892812 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:29.893284 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:29.894284 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:29.894710 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:29.961029 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-786e4583-38fa-49ad-bdf6-0d657a3bce55 req-d2dfa6d2-94fa-4fcf-b61e-3d70ebe26ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:29.961956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:29.961956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:05:29.970649 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-786e4583-38fa-49ad-bdf6-0d657a3bce55 req-d2dfa6d2-94fa-4fcf-b61e-3d70ebe26ad5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:29.971679 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-786e4583-38fa-49ad-bdf6-0d657a3bce55 req-d2dfa6d2-94fa-4fcf-b61e-3d70ebe26ad5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:29.987760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-786e4583-38fa-49ad-bdf6-0d657a3bce55 req-d2dfa6d2-94fa-4fcf-b61e-3d70ebe26ad5 service nova] Creating event network-changed:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:05:29.993190 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-786e4583-38fa-49ad-bdf6-0d657a3bce55 req-d2dfa6d2-94fa-4fcf-b61e-3d70ebe26ad5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038599 Feb 15 03:05:29.994149 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 209/414] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:30.142932 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:30.151673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-aaaa77a9-1e79-48e1-805b-460c56ce0efc tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1515 microversion: 2.1 time: 0.276071 Feb 15 03:05:30.152573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 206/415] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:29 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:30.167301 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:30.169809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:30.182051 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:30.183306 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:30.184785 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:30.185701 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:30.209718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:30.215696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:30.234591 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:30.235526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:30.236338 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:30.236775 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:30.423689 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:30.441196 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1869546a-bb56-4a1e-bc17-ff77bca816b4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1509 microversion: 2.1 time: 0.239633 Feb 15 03:05:30.442782 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 207/416] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:30 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:30.504578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:30.513079 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f3dd288a-ad3d-40a5-acb5-39d1027455fd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.353881 Feb 15 03:05:30.514155 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 210/417] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:30 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:31.183808 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:31.185248 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:31.199767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.200662 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.203330 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.204066 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.431863 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-e1ca851a-f5e6-409f-a526-55c345b29ab5 req-304bb03e-445b-42c3-800c-85be2fabf69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afb1287-b39f-4fd6-8b4a-c03103fcae40", "name": "network-vif-deleted", "tag": "fcb04533-33a8-4b4f-a640-9248b6f38139"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:31.433939 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:31.438950 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:31.438950 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:05:31.443127 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c5ac21a8-d93c-4465-bd64-7df9244cc2a8 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1515 microversion: 2.1 time: 0.263298 Feb 15 03:05:31.444271 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 208/418] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:31 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:31.465856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:31.468124 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:31.475717 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e1ca851a-f5e6-409f-a526-55c345b29ab5 req-304bb03e-445b-42c3-800c-85be2fabf69b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.477482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e1ca851a-f5e6-409f-a526-55c345b29ab5 req-304bb03e-445b-42c3-800c-85be2fabf69b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.477711 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.478163 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.479337 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.479830 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.511998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-e1ca851a-f5e6-409f-a526-55c345b29ab5 req-304bb03e-445b-42c3-800c-85be2fabf69b service nova] Creating event network-vif-deleted:fcb04533-33a8-4b4f-a640-9248b6f38139 for instance 2afb1287-b39f-4fd6-8b4a-c03103fcae40 on hv-cinder-82808 Feb 15 03:05:31.522891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-e1ca851a-f5e6-409f-a526-55c345b29ab5 req-304bb03e-445b-42c3-800c-85be2fabf69b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112267 Feb 15 03:05:31.525488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 211/419] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:31.545996 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:31.548838 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:31.566333 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.567771 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.570632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:31.572234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:31.607531 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:31.618495 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-20560fd2-7637-4067-8423-ff42ebb1d298 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 200 len: 1293 microversion: 2.1 time: 0.157560 Feb 15 03:05:31.619384 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 209/420] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:31 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:31.831272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:31.840461 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-42789b28-27f5-4fca-89d9-7518d8d57af2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.305605 Feb 15 03:05:31.843256 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 212/421] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:31 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:32.465899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:32.466662 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:32.476193 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.476757 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.477633 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.478142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.630458 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:32.634531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:32.635169 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: 2afb1287-b39f-4fd6-8b4a-c03103fcae40] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:32.638460 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4afb51bf-22fc-4f5a-b93a-24dc63260599 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 200 len: 1515 microversion: 2.1 time: 0.178436 Feb 15 03:05:32.639276 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 210/422] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:32 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:32.641974 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.642429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.643244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.643701 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.658114 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] HTTP exception thrown: Instance 2afb1287-b39f-4fd6-8b4a-c03103fcae40 could not be found. Feb 15 03:05:32.658716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Returning 404 to user: Instance 2afb1287-b39f-4fd6-8b4a-c03103fcae40 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:05:32.659575 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7cb3672d-9f13-47a4-8347-b0632614389d tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40" status: 404 len: 111 microversion: 2.1 time: 0.028715 Feb 15 03:05:32.660140 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 213/423] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:32 2022] GET /compute/v2.1/servers/2afb1287-b39f-4fd6-8b4a-c03103fcae40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 03:05:32.673462 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:32.674424 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:32.695190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.695190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.697503 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.698468 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.742097 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:05:32.830667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f6b40d81-797e-4a7a-95d8-a1dab67e4a71 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 204 len: 0 microversion: 2.1 time: 0.164039 Feb 15 03:05:32.831322 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 211/424] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:05:32 2022] DELETE /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:05:32.839780 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:32.841122 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:32.849673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.850123 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.850909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.851374 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.860375 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:32.861183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:32.868572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.869009 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:32.869899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:32.870346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:33.005872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:33.015320 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b401f6d1-08cc-4562-bc5d-2a5c79d72a75 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.179111 Feb 15 03:05:33.015916 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 214/425] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:32 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:33.034419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:33.042845 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-80d62f13-517e-4f0d-a5a6-cd2c667d78a7 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.188449 Feb 15 03:05:33.043472 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 212/426] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:32 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:33.542134 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-e21b3db1-1df5-4d24-be05-6b802193831c req-bf41cfda-566b-48b6-9cb3-7d9ad7533568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e416c8-8886-482e-8f52-bbda52dbf824", "name": "network-vif-deleted", "tag": "a8872dc1-8f95-4eaf-862c-38cedddd9d51"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:33.543777 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:33.543777 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:05:33.550812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e21b3db1-1df5-4d24-be05-6b802193831c req-bf41cfda-566b-48b6-9cb3-7d9ad7533568 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:33.551273 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e21b3db1-1df5-4d24-be05-6b802193831c req-bf41cfda-566b-48b6-9cb3-7d9ad7533568 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:33.563301 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-e21b3db1-1df5-4d24-be05-6b802193831c req-bf41cfda-566b-48b6-9cb3-7d9ad7533568 service nova] Creating event network-vif-deleted:a8872dc1-8f95-4eaf-862c-38cedddd9d51 for instance 90e416c8-8886-482e-8f52-bbda52dbf824 on hv-cinder-82808 Feb 15 03:05:33.569450 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-e21b3db1-1df5-4d24-be05-6b802193831c req-bf41cfda-566b-48b6-9cb3-7d9ad7533568 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030895 Feb 15 03:05:33.570050 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 215/427] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:33.655651 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:33.656322 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 90e416c8-8886-482e-8f52-bbda52dbf824] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:33.662981 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:33.663471 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:33.664277 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:33.664723 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:33.678477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] HTTP exception thrown: Instance 90e416c8-8886-482e-8f52-bbda52dbf824 could not be found. Feb 15 03:05:33.679069 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Returning 404 to user: Instance 90e416c8-8886-482e-8f52-bbda52dbf824 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:05:33.679930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-35935024-b8f1-401b-ac8b-5f1539adeaca tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824" status: 404 len: 111 microversion: 2.1 time: 0.028036 Feb 15 03:05:33.680489 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 213/428] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:33 2022] GET /compute/v2.1/servers/90e416c8-8886-482e-8f52-bbda52dbf824 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:05:34.037736 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:34.039051 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:34.053257 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:34.054472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:34.055554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:34.056110 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:34.064293 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:34.065457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:34.075684 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:34.076672 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:34.077699 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:34.078171 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:34.254235 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:34.262552 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8cb6df07-124b-4d6a-bcb2-8a5d3ad94a8e tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.230462 Feb 15 03:05:34.264498 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 216/429] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:34 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:34.266091 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:34.282747 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-401976b5-8047-4dbd-91ef-44ef0d97a46a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.225322 Feb 15 03:05:34.284022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 214/430] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:34 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:35.281266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:35.282071 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:35.288621 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:35.289077 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:35.289876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:35.290348 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:35.304491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:35.305536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:35.317097 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:35.317858 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:35.319227 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:35.319969 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:35.511316 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:35.519081 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-aac649f4-b20b-4419-afc4-58c033a5a590 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.241422 Feb 15 03:05:35.519716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 217/431] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:35 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:35.524484 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:35.533396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cfa9e096-a255-4902-82db-2a4141927b35 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.235402 Feb 15 03:05:35.534040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 215/432] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:35 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:36.539867 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:36.540466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:36.547888 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:36.548456 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:36.549357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:36.549914 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:36.554314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:36.555421 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:36.566064 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:36.566746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:36.568048 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:36.568800 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:36.707007 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:36.719328 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-71e307f2-7011-4222-b1f9-3b6429cd8b58 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.183624 Feb 15 03:05:36.719909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 218/433] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:36 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:36.744595 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:36.758863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3ef59611-0aea-4740-b53c-21c850c5cd5d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.210827 Feb 15 03:05:36.759958 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 216/434] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:36 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:37.739234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:37.739840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:37.746908 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:37.747456 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:37.749218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:37.749692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:37.781599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:37.782424 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:37.791283 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:37.791741 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:37.792587 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:37.793032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:37.943098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:37.956975 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0755152e-cdd5-4a8e-92b9-25697a531442 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1522 microversion: 2.1 time: 0.221403 Feb 15 03:05:37.957687 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 219/435] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:37 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:37.969241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:37.978077 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7e18715f-9426-4e46-9223-2d584dcb790c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.201227 Feb 15 03:05:37.978677 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 217/436] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:37 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:38.976070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:38.976769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:38.989595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:38.990082 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:38.990971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:38.991480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:39.011735 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:39.015560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:39.036026 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:39.039417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:39.043337 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:39.047309 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:39.222289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:39.240567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9552249e-3ea4-4470-aff5-d97ead1bda14 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1480 microversion: 2.1 time: 0.268079 Feb 15 03:05:39.255619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 220/437] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:38 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1480 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:39.302480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-7bc2de79-6ff4-451f-9020-f7dc74f10506 req-505be6eb-2d5d-457d-9030-a62af669696f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c947da6f-4d8e-46ce-8eba-63c9f3093204", "name": "network-vif-deleted", "tag": "5276e6ba-9658-4499-ac62-9419dd84fc02"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:39.304267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:39.304267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:05:39.314331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7bc2de79-6ff4-451f-9020-f7dc74f10506 req-505be6eb-2d5d-457d-9030-a62af669696f service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:39.314779 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7bc2de79-6ff4-451f-9020-f7dc74f10506 req-505be6eb-2d5d-457d-9030-a62af669696f service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:39.328231 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-7bc2de79-6ff4-451f-9020-f7dc74f10506 req-505be6eb-2d5d-457d-9030-a62af669696f service nova] Creating event network-vif-deleted:5276e6ba-9658-4499-ac62-9419dd84fc02 for instance c947da6f-4d8e-46ce-8eba-63c9f3093204 on hv-cinder-82808 Feb 15 03:05:39.334532 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-7bc2de79-6ff4-451f-9020-f7dc74f10506 req-505be6eb-2d5d-457d-9030-a62af669696f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044644 Feb 15 03:05:39.335835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 221/438] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:39.354242 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:39.369050 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-86344fc5-ed84-456a-9180-1bc1c03a90a3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.365489 Feb 15 03:05:39.370056 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 218/439] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:39 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:40.271466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:40.272600 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:40.282655 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:40.283486 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:40.284748 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:40.285508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:40.368164 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:40.376787 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-264f487f-2d07-41f1-8a0e-92c2ff4b3ec4 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1307 microversion: 2.1 time: 0.113622 Feb 15 03:05:40.377394 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 222/440] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:40 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:40.391667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:40.392669 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:40.402865 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:40.403369 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:40.404379 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:40.405131 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:40.557833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:40.566973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c1484c7d-5265-48f3-87ca-8827f224df09 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.182199 Feb 15 03:05:40.567604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 219/441] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:40 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:41.395261 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:41.395820 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:41.402482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:41.402936 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:41.403800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:41.404471 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:41.441941 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:41.442409 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:41.443051 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lazy-loading 'fault' on Instance uuid c947da6f-4d8e-46ce-8eba-63c9f3093204 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:05:41.494100 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6799561830b940349318816d80699079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4535bb088a284793a0937f05a754a26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:41.505338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-55ae4cf0-24b3-427a-a649-09fe3dea3d0a tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 200 len: 1312 microversion: 2.1 time: 0.114165 Feb 15 03:05:41.506165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 223/442] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:41 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:41.590114 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:41.591343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:41.604024 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:41.605428 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:41.607363 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:41.610420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:41.676529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2136512840", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "9378a579-260b-4873-b61c-261899e7b0f3"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:41.745487 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] validate_networks() for [('9378a579-260b-4873-b61c-261899e7b0f3', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:05:41.808172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:41.830007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bd09d62c-fffe-4218-a255-d818a696e453 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.248840 Feb 15 03:05:41.833560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 220/443] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:41 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:42.175875 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:05:42.176414 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:05:42.177037 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:05:42.177555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:05:42.178075 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:05:42.188581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:42.189035 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:42.189849 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:42.190285 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:42.209672 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Getting quotas for project 303d2e285f594249875c9a3de44a5ac2. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:05:42.215205 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Getting quotas for user bb2d306080c649b6af020eb43a44edb5 and project 303d2e285f594249875c9a3de44a5ac2. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:05:42.230093 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:05:42.233312 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:05:42.281798 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-58902d53-7b43-4be9-ae41-7b93035bd2aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612410 Feb 15 03:05:42.282465 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 224/444] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 03:05:42.293185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b619dea1-639a-490a-8377-852f2bfdc552 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:42.294069 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b619dea1-639a-490a-8377-852f2bfdc552 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:42.368590 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b619dea1-639a-490a-8377-852f2bfdc552 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:42.377213 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b619dea1-639a-490a-8377-852f2bfdc552 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1219 microversion: 2.1 time: 0.088088 Feb 15 03:05:42.377810 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 221/445] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:42 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:42.528335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:42.530568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] [instance: c947da6f-4d8e-46ce-8eba-63c9f3093204] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:42.539529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:42.539851 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:42.540928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:42.541595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:42.560098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] HTTP exception thrown: Instance c947da6f-4d8e-46ce-8eba-63c9f3093204 could not be found. Feb 15 03:05:42.561314 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] Returning 404 to user: Instance c947da6f-4d8e-46ce-8eba-63c9f3093204 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:05:42.562162 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-86a6d520-6166-4527-967e-a5567accb122 tempest-ServerRescueNegativeTestJSON-1631487060 tempest-ServerRescueNegativeTestJSON-1631487060-project] 10.222.0.24 "GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204" status: 404 len: 111 microversion: 2.1 time: 0.038847 Feb 15 03:05:42.562727 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 225/446] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:42 2022] GET /compute/v2.1/servers/c947da6f-4d8e-46ce-8eba-63c9f3093204 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:05:42.857597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:42.858411 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:42.865181 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:42.865894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:42.866915 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:42.867386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:43.071344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:43.080844 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5a93f22c-8302-4262-ba5c-a07fe668284a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.227213 Feb 15 03:05:43.081867 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 222/447] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:42 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:43.394673 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:43.395697 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:43.404544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:43.405963 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:43.406505 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:43.406677 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:43.551411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:43.561850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cf9ece5c-76ee-47f3-ae1a-1afcf63a6378 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1279 microversion: 2.1 time: 0.171225 Feb 15 03:05:43.573425 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 226/448] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:43 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:44.098236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:44.099537 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:44.107306 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:44.107773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:44.108587 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:44.109031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:44.308491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:44.325832 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3582df72-dbea-4b16-95e3-63e642e63019 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.231137 Feb 15 03:05:44.326505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 223/449] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:44 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:44.582035 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:44.583500 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:44.595732 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:44.596410 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:44.597683 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:44.598296 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:44.684858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:44.695788 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4133b3f7-09d2-4ad3-b118-de87d406062f tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1277 microversion: 2.1 time: 0.117478 Feb 15 03:05:44.696923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 227/450] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:44 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:45.348984 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:45.350162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:45.362773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:45.363618 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:45.365069 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:45.365843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:45.546449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:45.556409 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-eb6c6a7e-3dec-441a-a8f6-a27125da4ccf tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.214952 Feb 15 03:05:45.557006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 224/451] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:45 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:45.714119 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:45.715524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:45.725615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:45.726469 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:45.727551 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:45.728267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:46.018177 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:46.026003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-260d9297-f4f3-4047-a382-92653f9072e2 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1319 microversion: 2.1 time: 0.315477 Feb 15 03:05:46.027543 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 228/452] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:45 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:46.279212 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-96f3cee2-db1a-4952-8101-43a7bded1726 req-b81e8777-0f65-47d8-85fc-60f943fa8642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0c745a-243b-4b55-8279-36b92992e698", "tag": "678ee2ca-08ef-4d9d-9ce3-6f9e609f1bf4"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:46.282949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:46.282949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:05:46.293019 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-96f3cee2-db1a-4952-8101-43a7bded1726 req-b81e8777-0f65-47d8-85fc-60f943fa8642 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:46.293701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-96f3cee2-db1a-4952-8101-43a7bded1726 req-b81e8777-0f65-47d8-85fc-60f943fa8642 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:46.324214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-96f3cee2-db1a-4952-8101-43a7bded1726 req-b81e8777-0f65-47d8-85fc-60f943fa8642 service nova] Creating event network-changed:678ee2ca-08ef-4d9d-9ce3-6f9e609f1bf4 for instance 3a0c745a-243b-4b55-8279-36b92992e698 on hv-cinder-82808 Feb 15 03:05:46.330537 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-96f3cee2-db1a-4952-8101-43a7bded1726 req-b81e8777-0f65-47d8-85fc-60f943fa8642 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060890 Feb 15 03:05:46.331187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 225/453] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:46.578853 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:46.580102 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:46.592864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:46.593592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:46.595412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:46.596555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:46.943587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:46.956955 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3fc4bc90-9201-482c-8229-115771ca769b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.386041 Feb 15 03:05:46.957854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 229/454] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:46 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:47.045686 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:47.047698 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:47.054360 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:47.054807 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:47.055835 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:47.056270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:47.236478 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:47.248319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d6fdd2bb-a809-422b-b6d4-f4d2e7c311aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1319 microversion: 2.1 time: 0.207651 Feb 15 03:05:47.249464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 226/455] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:47 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:47.974367 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:47.975688 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:47.989760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:47.990555 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:47.992006 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:47.992817 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:48.187022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:48.195585 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3dda48fa-992c-4db3-ab22-0bb00a008eca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.224785 Feb 15 03:05:48.196169 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 230/456] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:47 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:48.265823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:48.266454 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:48.273010 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:48.273464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:48.274267 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:48.274711 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:48.449450 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:48.458239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a1ae7762-b078-40ed-8421-8d220f54cb6a tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1319 microversion: 2.1 time: 0.196904 Feb 15 03:05:48.459241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 227/457] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:48 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:49.097056 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-40643831-c08c-480c-9157-97d5a1750c57 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Action: 'create', calling method: .version_select at 0x7fe751b4b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1306442661", "metadata": {"Type": "work"}}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:49.221491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:49.222482 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:49.229075 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:49.229535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:49.230332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:49.230769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:49.426314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:49.443332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-52d91832-25c8-408b-bfbc-012b28afe6c5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.225206 Feb 15 03:05:49.444548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 228/458] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:49 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:49.478643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:49.479749 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:49.492227 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:49.493080 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:49.494470 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:49.495415 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:49.507048 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-40643831-c08c-480c-9157-97d5a1750c57 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.565009 Feb 15 03:05:49.511192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 231/459] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Feb 15 03:05:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 567 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 15 03:05:49.519608 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f0b1216d-18fc-4d9d-86b3-929bae8c76d2 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Calling method '.version_select at 0x7fe7518ac0d0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:49.574533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f0b1216d-18fc-4d9d-86b3-929bae8c76d2 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d" status: 200 len: 353 microversion: 2.1 time: 0.058552 Feb 15 03:05:49.575098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 232/460] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:05:49 2022] GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:49.684722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:49.693008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b6b22b9f-46b2-426e-a14c-dcc4d3608760 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1319 microversion: 2.1 time: 0.219987 Feb 15 03:05:49.693861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 229/461] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:49 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:50.462385 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:50.463324 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:50.470939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:50.471412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:50.472202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:50.472632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:50.587594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-26eeaa1c-46f2-4cfb-ad37-cccb6a0f2f8c tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Calling method '.version_select at 0x7fe7518bd040>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:50.619046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:50.628080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-bf6dec31-e34c-467e-99a7-5851f85a197e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.169145 Feb 15 03:05:50.628569 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 233/462] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:50 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:50.639316 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-26eeaa1c-46f2-4cfb-ad37-cccb6a0f2f8c tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d" status: 200 len: 354 microversion: 2.1 time: 0.054626 Feb 15 03:05:50.639881 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 230/463] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:05:50 2022] GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:50.651143 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-671044a5-b3be-4070-9f6a-d2df7e71895d tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Calling method '.version_select at 0x7fe752394af0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:50.699003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-671044a5-b3be-4070-9f6a-d2df7e71895d tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d" status: 200 len: 354 microversion: 2.1 time: 0.051637 Feb 15 03:05:50.699629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 234/464] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:05:50 2022] GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:50.712321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:50.713542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:50.715737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-56811f7c-f82b-43a8-a506-4d916140ca81 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Calling method '.version_select at 0x7fe751993d30>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:50.724186 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:50.725003 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:50.726388 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:50.727257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:50.780024 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-56811f7c-f82b-43a8-a506-4d916140ca81 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d" status: 202 len: 0 microversion: 2.1 time: 0.067554 Feb 15 03:05:50.780866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 235/465] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Feb 15 03:05:50 2022] DELETE /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:05:50.788281 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e4f01560-ec73-49c3-b521-5eb3eef5afcb tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Calling method '.version_select at 0x7fe7518acb80>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:50.846388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e4f01560-ec73-49c3-b521-5eb3eef5afcb tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d" status: 200 len: 353 microversion: 2.1 time: 0.061529 Feb 15 03:05:50.847036 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 236/466] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:05:50 2022] GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:50.896566 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:50.903968 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7fb0863f-6ae5-497b-a1cf-9c569e87c51c tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1319 microversion: 2.1 time: 0.197607 Feb 15 03:05:50.904570 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 231/467] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:50 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:51.273958 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-c74abaf8-32eb-43ab-a599-ad2850fe95f2 req-2ea6fbb7-7f14-4cf7-97a9-be9abd427238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0c745a-243b-4b55-8279-36b92992e698", "name": "network-vif-plugged", "status": "completed", "tag": "678ee2ca-08ef-4d9d-9ce3-6f9e609f1bf4"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:51.275534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:05:51.275534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:05:51.285010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-c74abaf8-32eb-43ab-a599-ad2850fe95f2 req-2ea6fbb7-7f14-4cf7-97a9-be9abd427238 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:51.285521 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-c74abaf8-32eb-43ab-a599-ad2850fe95f2 req-2ea6fbb7-7f14-4cf7-97a9-be9abd427238 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:51.298144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-c74abaf8-32eb-43ab-a599-ad2850fe95f2 req-2ea6fbb7-7f14-4cf7-97a9-be9abd427238 service nova] Creating event network-vif-plugged:678ee2ca-08ef-4d9d-9ce3-6f9e609f1bf4 for instance 3a0c745a-243b-4b55-8279-36b92992e698 on hv-cinder-82808 Feb 15 03:05:51.304153 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-c74abaf8-32eb-43ab-a599-ad2850fe95f2 req-2ea6fbb7-7f14-4cf7-97a9-be9abd427238 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033742 Feb 15 03:05:51.304815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 237/468] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:05:51.644536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:51.645143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:51.651466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:51.651925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:51.652707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:51.653208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:51.800394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:51.808430 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7cd8c8a4-3f43-4385-a5aa-98c85308909c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.167436 Feb 15 03:05:51.808936 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 232/469] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:51 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:51.859768 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-44c47ebc-53ed-439f-96ed-d19300581e31 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Calling method '.version_select at 0x7fe7518ac5e0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:51.887260 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-44c47ebc-53ed-439f-96ed-d19300581e31 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] HTTP exception thrown: Volume 628184e3-4061-4ccf-a71f-25ffd881357d could not be found. Feb 15 03:05:51.887870 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-44c47ebc-53ed-439f-96ed-d19300581e31 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] Returning 404 to user: Volume 628184e3-4061-4ccf-a71f-25ffd881357d could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:05:51.889352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-44c47ebc-53ed-439f-96ed-d19300581e31 tempest-VolumesGetTestJSON-2102123023 tempest-VolumesGetTestJSON-2102123023-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d" status: 404 len: 109 microversion: 2.1 time: 0.034076 Feb 15 03:05:51.889971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 238/470] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Feb 15 03:05:51 2022] GET /compute/v2.1/os-volumes/628184e3-4061-4ccf-a71f-25ffd881357d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:05:51.920824 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:51.921443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:51.927443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:51.927903 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:51.928705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:51.929147 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:52.078390 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:52.088652 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-240c91c3-5800-4c20-b3fe-1c46b21d5043 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1319 microversion: 2.1 time: 0.171407 Feb 15 03:05:52.089241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 233/471] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:51 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:52.832181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:52.833531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:52.849069 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:52.850032 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:52.851556 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:52.852557 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:53.032559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:53.045854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d89c9f67-7e70-4c8a-8a44-6378dc7650f8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.222839 Feb 15 03:05:53.046543 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 239/472] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:52 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:53.107203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:53.107827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:53.113868 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:53.114318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:53.115144 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:53.115612 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:53.299740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:53.312878 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-84c66ab0-ce39-4f7a-b66d-f195bbf86d26 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1508 microversion: 2.1 time: 0.209600 Feb 15 03:05:53.313720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 234/473] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:53 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:53.335127 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfe6a115-8a67-427c-8587-d78ba585d511", "device": "/dev/sdb"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:53.336282 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:53.343344 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:53.343710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:53.344501 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:53.344932 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:53.608128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cef447dc-1eb6-4113-97b7-c8ea1928b4aa tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "POST /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275974 Feb 15 03:05:53.608644 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 240/474] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:05:53 2022] POST /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:05:54.069705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:54.070332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:54.078614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:54.079484 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:54.080773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:54.081409 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:54.362724 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:54.372454 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1e025f0a-2aab-4962-a665-a6806cd6b725 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1722 microversion: 2.1 time: 0.308007 Feb 15 03:05:54.373915 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 235/475] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:54 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:55.391390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:55.392103 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:55.399289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:55.399747 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:55.400562 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:55.401002 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:55.811335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:55.822976 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4ece25d4-0bb1-4343-ab0a-59bf7141dba6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1699 microversion: 2.1 time: 0.435951 Feb 15 03:05:55.823785 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 241/476] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:55 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1699 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:05:55.844813 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0d0deb0b-bdb6-4b27-af2a-96f201743632 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:05:55.854558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0d0deb0b-bdb6-4b27-af2a-96f201743632 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:55.855040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0d0deb0b-bdb6-4b27-af2a-96f201743632 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:55.891853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0d0deb0b-bdb6-4b27-af2a-96f201743632 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Going to try to start instance {{(pid=116501) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 15 03:05:55.977722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0d0deb0b-bdb6-4b27-af2a-96f201743632 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action" status: 202 len: 0 microversion: 2.1 time: 0.138482 Feb 15 03:05:55.978991 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 236/477] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:05:55 2022] POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:05:55.987959 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:55.989038 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:55.995704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:55.996623 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:55.998325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:55.999753 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:56.182346 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:56.195275 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b97bc4fe-9c6b-472e-af6e-356cc56681fe tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1708 microversion: 2.1 time: 0.210851 Feb 15 03:05:56.204375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 242/478] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:55 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1708 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:57.227200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:57.227962 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:57.238125 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:57.238929 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:57.240413 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:57.240865 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:57.422121 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:57.431593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b3f13120-611f-4ba3-80c4-517b61ef392b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1708 microversion: 2.1 time: 0.211214 Feb 15 03:05:57.432467 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 237/479] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:57 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1708 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:05:58.450027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:05:58.450658 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:05:58.458388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:58.458851 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:58.459703 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:05:58.460144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:05:58.727586 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:05:58.744942 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7385d9ed-bfe7-44c5-9a4e-799c29f76634 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1712 microversion: 2.1 time: 0.298367 Feb 15 03:05:58.746063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 243/480] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:05:58 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1712 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:06:08.761155 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:08.762044 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:08.771050 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:08.771537 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:08.772827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:08.772827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:08.807944 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a5e12528-1a6f-4007-93f8-abec73c08f79 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments/af525c90-45eb-445f-893d-43625df9e52c" status: 200 len: 194 microversion: 2.20 time: 0.054585 Feb 15 03:06:08.808828 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 238/481] 10.222.0.24 () {60 vars in 1453 bytes} [Tue Feb 15 03:06:08 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments/af525c90-45eb-445f-893d-43625df9e52c => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:06:08.893383 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:08.894218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:08.906192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:08.906981 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:08.908421 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:08.908739 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:09.037066 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lazy-loading 'services' on Instance uuid 73cd6519-d67b-4635-af86-336ae2fde18b {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:06:09.163248 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3c801534-3cd7-45ed-a94c-e54804675df3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments/af525c90-45eb-445f-893d-43625df9e52c" status: 202 len: 0 microversion: 2.20 time: 0.276289 Feb 15 03:06:09.164315 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 244/482] 10.222.0.24 () {60 vars in 1456 bytes} [Tue Feb 15 03:06:08 2022] DELETE /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments/af525c90-45eb-445f-893d-43625df9e52c => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:06:09.179228 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:09.181138 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:09.192789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:09.194313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:09.196690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:09.197859 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:09.266199 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5879ee76-55f7-4044-a1a8-078dda009363 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094930 Feb 15 03:06:09.266972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 239/483] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Feb 15 03:06:09 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:06:10.285753 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:10.287188 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:10.295278 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:10.295697 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:10.296562 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:10.297041 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:10.338622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c41f0a0c-a366-4657-83d5-d0d89146f04c tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062833 Feb 15 03:06:10.339609 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 245/484] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Feb 15 03:06:10 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:10.417685 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:10.418353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:10.425970 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:10.426506 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:10.427418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:10.427939 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:10.457560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:06:10.569672 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-30700215-c93c-42ee-8036-349df8567e69 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 204 len: 0 microversion: 2.20 time: 0.155346 Feb 15 03:06:10.570533 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 240/485] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Feb 15 03:06:10 2022] DELETE /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 03:06:10.580833 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:10.581872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:10.589076 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:10.589713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:10.590592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:10.591400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:10.789761 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:10.800444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:10.802129 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:10.804580 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5088b2fc-bf65-433d-9d93-a5c1470f468a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.228376 Feb 15 03:06:10.805427 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 246/486] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:10 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:11.830868 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:11.831830 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:11.843943 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:11.844772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:11.846185 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:11.846964 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:12.009555 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:12.021614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:12.024357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:12.026236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-200d6ff6-5369-46f0-989e-43f9b341ab6f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.204403 Feb 15 03:06:12.027212 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 241/487] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:11 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:12.372338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:12.373094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:12.380475 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:12.380934 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:12.381746 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:12.382184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:12.478587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lazy-loading 'services' on Instance uuid 3a0c745a-243b-4b55-8279-36b92992e698 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:06:12.565039 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-bd4ef334-8069-4989-ad48-66dfa3977b1b tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698/os-volume_attachments/bfe6a115-8a67-427c-8587-d78ba585d511" status: 202 len: 0 microversion: 2.1 time: 0.196295 Feb 15 03:06:12.565972 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 247/488] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:06:12 2022] DELETE /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698/os-volume_attachments/bfe6a115-8a67-427c-8587-d78ba585d511 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:06:13.050126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:13.051179 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:13.062814 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:13.063638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:13.065152 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:13.065991 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:13.336208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:13.347784 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:13.349597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:13.350928 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b3d0d6b7-c361-42ec-b64d-4bb27a6e47b9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1722 microversion: 2.20 time: 0.308154 Feb 15 03:06:13.352024 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 242/489] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:13 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:13.758006 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:13.759068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:13.771374 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:13.772217 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:13.773724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:13.774981 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:13.823517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:06:13.939844 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7e4a8087-029b-40c6-813c-e7895b85e55e tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 204 len: 0 microversion: 2.1 time: 0.190249 Feb 15 03:06:13.941149 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 248/490] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:06:13 2022] DELETE /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:06:13.949554 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:13.950239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:13.965654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:13.967346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:13.969013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:13.969640 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:14.073327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-ca351c53-afa3-4e30-9a24-e8efd3cf25f2 req-120234ac-3920-4d49-a6f7-dbd34f9cf359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cd6519-d67b-4635-af86-336ae2fde18b", "name": "network-vif-deleted", "tag": "5bc40f19-47a8-4cc5-a5e3-1c35392b5b48"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:14.075597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:06:14.075597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:06:14.084608 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ca351c53-afa3-4e30-9a24-e8efd3cf25f2 req-120234ac-3920-4d49-a6f7-dbd34f9cf359 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:14.085065 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ca351c53-afa3-4e30-9a24-e8efd3cf25f2 req-120234ac-3920-4d49-a6f7-dbd34f9cf359 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:14.099366 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-ca351c53-afa3-4e30-9a24-e8efd3cf25f2 req-120234ac-3920-4d49-a6f7-dbd34f9cf359 service nova] Creating event network-vif-deleted:5bc40f19-47a8-4cc5-a5e3-1c35392b5b48 for instance 73cd6519-d67b-4635-af86-336ae2fde18b on hv-cinder-82808 Feb 15 03:06:14.109003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-ca351c53-afa3-4e30-9a24-e8efd3cf25f2 req-120234ac-3920-4d49-a6f7-dbd34f9cf359 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042185 Feb 15 03:06:14.109633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 249/491] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:06:14.200433 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:14.214043 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0b366376-28e4-49dd-a7e8-5b35de54fe62 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1514 microversion: 2.1 time: 0.268249 Feb 15 03:06:14.216161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 243/492] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:13 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:14.388328 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:14.388328 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:14.398177 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:14.398711 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:14.400301 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:14.400301 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:14.470894 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:14.471832 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:14.472937 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lazy-loading 'fault' on Instance uuid 73cd6519-d67b-4635-af86-336ae2fde18b {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:06:14.527347 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:14.540167 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:14.543739 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:14.548126 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-35c3b072-cffe-4fed-a653-6719e8b9c751 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 200 len: 1370 microversion: 2.20 time: 0.169497 Feb 15 03:06:14.559204 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 250/493] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:14 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:15.233999 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:15.235280 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:15.245208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:15.245757 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:15.247170 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:15.247901 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:15.515746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:15.535253 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-58fa3768-28bb-43e1-b85d-cddda0c69795 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1514 microversion: 2.1 time: 0.304123 Feb 15 03:06:15.536874 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 244/494] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:15 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:15.569511 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:15.570895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:15.578732 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:15.579544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:15.580356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:15.580998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:15.608134 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] HTTP exception thrown: Instance 73cd6519-d67b-4635-af86-336ae2fde18b could not be found. Feb 15 03:06:15.609457 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Returning 404 to user: Instance 73cd6519-d67b-4635-af86-336ae2fde18b could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:06:15.613672 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-efd8548a-ea7e-4470-9283-23b6d5e75182 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 404 len: 111 microversion: 2.20 time: 0.048470 Feb 15 03:06:15.625233 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fd3d602d-dce0-4029-a315-c0cb2a57891b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '.version_select at 0x7fe752260160>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:15.628750 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 251/495] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:15 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 03:06:15.672998 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fd3d602d-dce0-4029-a315-c0cb2a57891b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946027531" status: 204 len: 0 microversion: 2.20 time: 0.051731 Feb 15 03:06:15.681202 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 245/496] 10.222.0.24 () {60 vars in 1258 bytes} [Tue Feb 15 03:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946027531 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 03:06:16.566378 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:16.567183 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:16.597147 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:16.604023 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:16.608884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:16.609906 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:16.807528 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2d306080c649b6af020eb43a44edb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '303d2e285f594249875c9a3de44a5ac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:16.824731 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-923da4d6-e444-4569-a605-e3080801bc1d tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 200 len: 1472 microversion: 2.1 time: 0.268321 Feb 15 03:06:16.826324 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 252/497] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:16 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 1472 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:16.913934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4aa3e85a-2a18-48c1-aa49-65cf7378b40d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'create', calling method: .version_select at 0x7fe75225d430>, body: {"keypair": {"name": "tempest-keypair-1740853904"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:16.943011 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-8102d669-f984-4d0b-9ad1-4f3c4615a82c req-2db463e2-8aa6-4bed-91e6-caf2ca81a0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0c745a-243b-4b55-8279-36b92992e698", "name": "network-vif-deleted", "tag": "678ee2ca-08ef-4d9d-9ce3-6f9e609f1bf4"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:16.946630 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:06:16.946630 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:06:16.950109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-4aa3e85a-2a18-48c1-aa49-65cf7378b40d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:06:16.959338 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-4aa3e85a-2a18-48c1-aa49-65cf7378b40d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for user 7df8d655a1264611a45016ecc787871e and project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:06:16.977981 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-8102d669-f984-4d0b-9ad1-4f3c4615a82c req-2db463e2-8aa6-4bed-91e6-caf2ca81a0d2 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:16.982576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-8102d669-f984-4d0b-9ad1-4f3c4615a82c req-2db463e2-8aa6-4bed-91e6-caf2ca81a0d2 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:17.023086 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-8102d669-f984-4d0b-9ad1-4f3c4615a82c req-2db463e2-8aa6-4bed-91e6-caf2ca81a0d2 service nova] Creating event network-vif-deleted:678ee2ca-08ef-4d9d-9ce3-6f9e609f1bf4 for instance 3a0c745a-243b-4b55-8279-36b92992e698 on hv-cinder-82808 Feb 15 03:06:17.040531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-8102d669-f984-4d0b-9ad1-4f3c4615a82c req-2db463e2-8aa6-4bed-91e6-caf2ca81a0d2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104644 Feb 15 03:06:17.051947 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 253/498] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:06:17.220006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-4aa3e85a-2a18-48c1-aa49-65cf7378b40d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:06:17.224752 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-4aa3e85a-2a18-48c1-aa49-65cf7378b40d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for user 7df8d655a1264611a45016ecc787871e and project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:06:17.241889 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4aa3e85a-2a18-48c1-aa49-65cf7378b40d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.335290 Feb 15 03:06:17.242623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 246/499] 10.222.0.24 () {62 vars in 1198 bytes} [Tue Feb 15 03:06:16 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 337 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 15 03:06:17.854247 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:17.854247 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] [instance: 3a0c745a-243b-4b55-8279-36b92992e698] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:17.863962 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:17.864503 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:17.865538 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:17.866262 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:17.884812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] HTTP exception thrown: Instance 3a0c745a-243b-4b55-8279-36b92992e698 could not be found. Feb 15 03:06:17.885867 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] Returning 404 to user: Instance 3a0c745a-243b-4b55-8279-36b92992e698 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:06:17.886868 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ac6b7c11-06c8-4b92-bd37-87a3ca7156f0 tempest-VolumesSnapshotTestJSON-902273813 tempest-VolumesSnapshotTestJSON-902273813-project] 10.222.0.24 "GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698" status: 404 len: 111 microversion: 2.1 time: 0.044044 Feb 15 03:06:17.891535 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 254/500] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:17 2022] GET /compute/v2.1/servers/3a0c745a-243b-4b55-8279-36b92992e698 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:06:19.279787 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-724006529", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c1a999e-ee82-4c20-9c13-04652372776f"}], "security_groups": [{"name": "tempest-securitygroup--79337007"}], "key_name": "tempest-keypair-1740853904", "user_data": "}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:19.404502 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] validate_networks() for [('4c1a999e-ee82-4c20-9c13-04652372776f', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:06:19.830867 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:06:19.831338 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:06:19.831812 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:06:19.832218 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:06:19.832625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:06:19.851397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:19.851843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:19.852641 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:19.853073 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:19.870604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:06:19.875505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Getting quotas for user 7df8d655a1264611a45016ecc787871e and project 6c08d74d0cb140cfa09ddc3f8102b7c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:06:19.887851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:06:19.890795 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:06:19.940400 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5ab8bc77-5cce-4495-b136-9ab965455a1b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.665340 Feb 15 03:06:19.941047 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 247/501] 10.222.0.24 () {62 vars in 1187 bytes} [Tue Feb 15 03:06:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 15 03:06:19.958370 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ab3ec7b5-3838-4163-aec4-c6ec34db43ac tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:19.958989 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ab3ec7b5-3838-4163-aec4-c6ec34db43ac tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:20.017612 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ab3ec7b5-3838-4163-aec4-c6ec34db43ac tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:20.025599 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ab3ec7b5-3838-4163-aec4-c6ec34db43ac tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:20.027109 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ab3ec7b5-3838-4163-aec4-c6ec34db43ac tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:20.028272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ab3ec7b5-3838-4163-aec4-c6ec34db43ac tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1281 microversion: 2.20 time: 0.077605 Feb 15 03:06:20.029657 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 255/502] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:19 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:21.047833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:21.048432 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:21.055041 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:21.055529 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:21.056321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:21.056765 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:21.121830 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:21.130898 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:21.132468 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:21.133596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4d28a820-63d0-43fa-8e32-3330c484f6bb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1285 microversion: 2.20 time: 0.090080 Feb 15 03:06:21.134162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 248/503] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:21 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:22.157552 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:22.158242 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:22.170108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:22.170903 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:22.172578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:22.173559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:22.274286 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:22.284924 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:22.287298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:22.288812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6921112a-4a46-4a76-80e0-4125a05067c9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1285 microversion: 2.20 time: 0.136855 Feb 15 03:06:22.289489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 256/504] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:22 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:23.308731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:23.309610 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:23.317744 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:23.318225 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:23.319076 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:23.319651 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:23.385434 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:23.394175 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:23.395745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:23.396885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-00a59fec-4afb-423c-8d88-7e1b9bfa3413 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1339 microversion: 2.20 time: 0.092454 Feb 15 03:06:23.397462 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 249/505] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:23 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:24.416168 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:24.416766 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:24.423947 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:24.424482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:24.425357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:24.425858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:24.752971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:24.761534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:24.763774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:24.764944 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9c1f380b-cb28-43e1-b0c0-c686df57a3ab tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.352595 Feb 15 03:06:24.765530 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 257/506] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:24 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:25.304896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-1cb83e1c-52e1-48af-81fe-c8d93235bbd1 req-c8a5efef-c1b5-4528-8f62-f6fc42fcc7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:25.319481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:06:25.319481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:06:25.337737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-1cb83e1c-52e1-48af-81fe-c8d93235bbd1 req-c8a5efef-c1b5-4528-8f62-f6fc42fcc7a1 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:25.339136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-1cb83e1c-52e1-48af-81fe-c8d93235bbd1 req-c8a5efef-c1b5-4528-8f62-f6fc42fcc7a1 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:25.363138 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-1cb83e1c-52e1-48af-81fe-c8d93235bbd1 req-c8a5efef-c1b5-4528-8f62-f6fc42fcc7a1 service nova] Creating event network-changed:c54c020e-ee76-46b5-9b5c-5abb119c8f80 for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e on hv-cinder-82808 Feb 15 03:06:25.369325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-1cb83e1c-52e1-48af-81fe-c8d93235bbd1 req-c8a5efef-c1b5-4528-8f62-f6fc42fcc7a1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071979 Feb 15 03:06:25.370412 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 250/507] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:06:25.782917 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:25.783708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:25.790181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:25.790637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:25.791505 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:25.791948 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:25.977684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:25.987378 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:25.988902 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:25.990063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-42fb7bb5-2912-4254-bd1a-9d8c8e4b0c20 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.210970 Feb 15 03:06:25.990622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 258/508] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:25 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:27.015354 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:27.017028 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:27.028513 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:27.029967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:27.031484 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:27.032278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:27.220468 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:27.229157 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:27.230863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:27.232072 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-80249991-5f4d-4166-b643-6c0f3e511dd0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.225289 Feb 15 03:06:27.232672 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 251/509] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:27 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:28.250104 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:28.250714 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:28.257277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:28.257735 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:28.258536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:28.259001 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:28.413524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:28.423072 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:28.424646 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:28.425800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-31871873-2bcf-404e-b5f4-0c34959f6499 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.179608 Feb 15 03:06:28.426374 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 259/510] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:28 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:06:29.446583 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:29.447750 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:29.459340 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:29.459996 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:29.461480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:29.462263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:29.623449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:29.632070 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:29.633593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:29.634707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0e10923b-2f95-4a2d-99d9-8651115ae0b8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.193999 Feb 15 03:06:29.635288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 252/511] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:29 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:30.653120 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:30.653775 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:30.661165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:30.661617 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:30.662419 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:30.662856 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:30.809032 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:30.817850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:30.819563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:30.820848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c238c383-e9ae-4d64-a078-70246c63a46d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.171777 Feb 15 03:06:30.821464 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 260/512] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:30 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:06:31.462732 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-c5ef4a2e-fcda-464f-ba42-b1a340799e55 req-f96b9822-d829-4bf5-8a2b-1da0e4b3f844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "name": "network-vif-plugged", "status": "completed", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:31.464978 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:06:31.464978 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:06:31.474085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c5ef4a2e-fcda-464f-ba42-b1a340799e55 req-f96b9822-d829-4bf5-8a2b-1da0e4b3f844 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:31.475262 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c5ef4a2e-fcda-464f-ba42-b1a340799e55 req-f96b9822-d829-4bf5-8a2b-1da0e4b3f844 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:31.490762 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-c5ef4a2e-fcda-464f-ba42-b1a340799e55 req-f96b9822-d829-4bf5-8a2b-1da0e4b3f844 service nova] Creating event network-vif-plugged:c54c020e-ee76-46b5-9b5c-5abb119c8f80 for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e on hv-cinder-82808 Feb 15 03:06:31.498014 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-c5ef4a2e-fcda-464f-ba42-b1a340799e55 req-f96b9822-d829-4bf5-8a2b-1da0e4b3f844 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037625 Feb 15 03:06:31.498748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 253/513] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:06:31.840294 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:31.841597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:31.849702 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:31.850192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:31.851038 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:31.851568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:32.016647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:32.025236 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:32.026770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:32.027946 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c363b1da-da5f-454c-a84b-c0494329c844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1405 microversion: 2.20 time: 0.191736 Feb 15 03:06:32.028509 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 261/514] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:31 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:33.055895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:33.056498 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:33.064380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:33.064833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:33.065631 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:33.066073 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:33.244738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:33.253960 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:33.255536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:33.256739 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4e96c966-4af6-4150-a5c1-b94d20cc9664 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1598 microversion: 2.20 time: 0.205038 Feb 15 03:06:33.257344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 254/515] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:06:33 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1598 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:06:33.274749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:33.275411 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:33.282721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:33.283213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:33.284023 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:33.284483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:33.374318 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9907c4da-50e9-4a83-af13-43432dda7a52 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103296 Feb 15 03:06:33.374912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 262/516] 10.222.0.24 () {60 vars in 1315 bytes} [Tue Feb 15 03:06:33 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 03:06:34.568294 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-3078c61b-fed1-4249-bf26-c34495dd727f req-8bb1b7a0-2e88-4cb4-9639-7e411291d5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:34.569522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:34.569892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:06:34.569892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:06:34.570394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:34.577168 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3078c61b-fed1-4249-bf26-c34495dd727f req-8bb1b7a0-2e88-4cb4-9639-7e411291d5f4 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:34.577920 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3078c61b-fed1-4249-bf26-c34495dd727f req-8bb1b7a0-2e88-4cb4-9639-7e411291d5f4 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:34.581751 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:34.582573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:34.584013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:34.584515 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:34.589649 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-3078c61b-fed1-4249-bf26-c34495dd727f req-8bb1b7a0-2e88-4cb4-9639-7e411291d5f4 service nova] Creating event network-changed:c54c020e-ee76-46b5-9b5c-5abb119c8f80 for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e on hv-cinder-82808 Feb 15 03:06:34.595402 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-3078c61b-fed1-4249-bf26-c34495dd727f req-8bb1b7a0-2e88-4cb4-9639-7e411291d5f4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Feb 15 03:06:34.596354 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 263/517] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:06:34.617353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-da5bce56-f7af-445d-ab18-2d6b239bb1e4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/ips" status: 200 len: 113 microversion: 2.20 time: 0.055475 Feb 15 03:06:34.618050 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 255/518] 10.222.0.24 () {60 vars in 1288 bytes} [Tue Feb 15 03:06:34 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/ips => generated 113 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 15 03:06:38.930517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:38.931333 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:38.939886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:38.940345 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:38.941152 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:38.941594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:39.045991 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lazy-loading 'services' on Instance uuid 5dda008d-d3be-48d2-b87b-93c578e8d7b9 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:06:39.116710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8f58e59b-e8f3-40fd-9756-9a1704e7824e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-volume_attachments/e2b2db53-d501-4977-95ae-ede8c753c172" status: 202 len: 0 microversion: 2.1 time: 0.192119 Feb 15 03:06:39.117825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 264/519] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:06:38 2022] DELETE /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-volume_attachments/e2b2db53-d501-4977-95ae-ede8c753c172 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:06:40.259876 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d826b5a1-14d5-4b46-ac2c-7e06f088f93b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:40.266605 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d826b5a1-14d5-4b46-ac2c-7e06f088f93b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:40.267718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d826b5a1-14d5-4b46-ac2c-7e06f088f93b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:40.293344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d826b5a1-14d5-4b46-ac2c-7e06f088f93b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Going to try to stop instance {{(pid=116501) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 15 03:06:40.343586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d826b5a1-14d5-4b46-ac2c-7e06f088f93b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action" status: 202 len: 0 microversion: 2.1 time: 0.086489 Feb 15 03:06:40.344367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 256/520] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:06:40 2022] POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:06:40.354613 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:40.355375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:40.363991 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:40.364525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:40.365692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:40.366671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:40.567234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:40.594841 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e3408897-cfaa-436c-b81b-3a0299c0e184 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.245612 Feb 15 03:06:40.607508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 265/521] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:40 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:41.613873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:41.614690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:41.625150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:41.625150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:41.625150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:41.625150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:41.802886 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:41.820261 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4f791266-3fb0-4d9e-b4e0-cd4e72f606ca tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.210899 Feb 15 03:06:41.821150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 257/522] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:41 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:42.840209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:42.840757 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:42.847708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:42.848176 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:42.848984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:42.849419 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:43.014620 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:43.022290 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8375bf49-eebe-4285-ab75-ef9fb3595b63 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.185785 Feb 15 03:06:43.022879 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 266/523] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:42 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:44.040151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:44.041041 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:44.047700 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:44.048154 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:44.048975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:44.049418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:44.190248 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:44.197957 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-99b82a68-1a5a-4da1-aadb-bcf0bf4e50d1 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.161326 Feb 15 03:06:44.198343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 258/524] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:44 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:45.214655 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:45.215512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:45.224790 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:45.225246 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:45.226078 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:45.226521 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:45.370250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:45.378240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-81ab5d20-04dc-477d-843a-9784507c3ace tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.167215 Feb 15 03:06:45.378811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 267/525] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:45 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:46.395992 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:46.396643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:46.402987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:46.403472 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:46.404335 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:46.404771 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:46.589015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:46.602860 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3480c039-7158-4994-aa4d-9b8afb834ddd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.210455 Feb 15 03:06:46.604021 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 259/526] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:46 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:06:47.621928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:47.622745 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:47.629438 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:47.629887 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:47.630681 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:47.631121 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:47.779997 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:47.787853 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2f63fde1-a051-439b-97c2-fccb70552fe4 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.169708 Feb 15 03:06:47.788437 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 268/527] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:47 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:48.806274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:48.807096 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:48.815015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:48.815588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:48.816402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:48.816888 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:48.975673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:48.984740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-de671222-6d8e-4f8d-8596-60afb38af464 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.182640 Feb 15 03:06:48.985331 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 260/528] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:48 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:50.002115 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:50.002729 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:50.009033 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:50.009482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:50.010262 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:50.010693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:50.161829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:50.170144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c978e26e-4f54-419b-82be-f5bbb6975c7c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.172081 Feb 15 03:06:50.170737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 269/529] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:49 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:51.189947 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:51.191333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:51.199494 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:51.199986 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:51.200795 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:51.201241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:51.354242 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:51.367111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-69f4b553-1f23-4ce6-a899-35ced612059a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.180976 Feb 15 03:06:51.367949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 261/530] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:51 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:52.385158 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:52.385772 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:52.392431 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:52.392891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:52.393714 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:52.394151 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:52.535915 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:52.543934 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-58080637-2caf-49b6-8021-29e2d961a23d tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.162410 Feb 15 03:06:52.544510 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 270/531] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:52 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:53.561131 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:53.563089 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:53.569576 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:53.570113 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:53.570986 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:53.571464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:53.718926 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:53.726260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-004dc9a8-49ad-4171-9f37-d91e12860fb5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.168731 Feb 15 03:06:53.727065 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 262/532] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:53 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:54.746463 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:54.747079 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:54.753304 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:54.753759 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:54.754546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:54.754990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:54.896509 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:54.903824 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-669d060c-460e-45a8-b0f7-ccbbf2daf01f tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.161165 Feb 15 03:06:54.904390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 271/533] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:54 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:55.920505 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:55.921417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:55.928277 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:55.928864 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:55.929655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:55.930140 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:56.067435 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:56.075768 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fa5988b9-f2a4-449e-9611-f736e7f521ee tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1676 microversion: 2.1 time: 0.159799 Feb 15 03:06:56.076335 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 263/534] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:55 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:57.095626 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:57.096244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:57.102059 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:57.102516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:57.103348 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:57.103797 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:57.236416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:57.243718 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7a88c6c7-dfa4-407f-836e-1983cc8abdfd tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1653 microversion: 2.1 time: 0.154320 Feb 15 03:06:57.244291 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 272/535] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:57 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:57.259709 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a387b812-f954-47ca-8ed4-293af05a64f6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:06:57.266515 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a387b812-f954-47ca-8ed4-293af05a64f6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:57.266969 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a387b812-f954-47ca-8ed4-293af05a64f6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:57.289004 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a387b812-f954-47ca-8ed4-293af05a64f6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Going to try to start instance {{(pid=116501) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 15 03:06:57.331091 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a387b812-f954-47ca-8ed4-293af05a64f6 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action" status: 202 len: 0 microversion: 2.1 time: 0.074843 Feb 15 03:06:57.331731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 264/536] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:06:57 2022] POST /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:06:57.339895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:57.340606 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:57.347022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:57.347709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:57.348618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:57.349175 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:57.562735 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:57.569956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ff05503d-9613-4947-9ab5-923379c0aeef tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1662 microversion: 2.1 time: 0.233855 Feb 15 03:06:57.570523 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 273/537] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:57 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1662 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:06:58.588235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:06:58.589032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:06:58.595720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:58.596211 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:58.597023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:06:58.597458 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:06:58.760761 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:06:58.768961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0c252af1-2f1f-4b7f-b75f-9823789fcd71 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1666 microversion: 2.1 time: 0.185109 Feb 15 03:06:58.769736 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 265/538] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:06:58 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1666 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:12.251659 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:12.252250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:12.258431 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:12.258880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:12.259684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:12.260121 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:12.283758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lazy-loading 'flavor' on Instance uuid 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:07:12.545283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f90db271-6572-4963-bf93-5d2b8831b53a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/action" status: 202 len: 0 microversion: 2.20 time: 0.297219 Feb 15 03:07:12.546439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 274/539] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Feb 15 03:07:12 2022] POST /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:07:12.555574 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:12.556290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:12.563663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:12.564184 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:12.565054 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:12.565543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:12.717823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:12.726933 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:12.728493 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:12.729702 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a184248c-29c2-446c-bdc7-686e83d6e83a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.178059 Feb 15 03:07:12.730263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 266/540] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:12 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:13.749843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:13.750546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:13.757230 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:13.757689 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:13.758493 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:13.758937 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:13.895728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:13.904582 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:13.906229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:13.907456 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e26b7ed7-5c9d-46fa-9dff-e62eb49d3707 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.162259 Feb 15 03:07:13.908025 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 275/541] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:13 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:14.926607 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:14.927264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:14.936050 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:14.936884 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:14.938278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:14.939042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:15.088650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:15.097552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:15.099061 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:15.100244 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f54ae271-980d-4890-ae60-08b5f5205a75 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.177595 Feb 15 03:07:15.100802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 267/542] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:14 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:16.119052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:16.119678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:16.127165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:16.127619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:16.128409 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:16.128840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:16.272131 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:16.280238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:16.281882 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:16.283062 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-90ae0498-3a3d-4886-bbcb-3cebaac81844 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.167776 Feb 15 03:07:16.283667 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 276/543] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:16 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:17.301422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:17.302032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:17.308565 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:17.309013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:17.309863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:17.310354 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:17.609819 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:17.618158 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:17.619695 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:17.620869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b7df48f1-a755-4f4f-8b08-5e1aa1fdd847 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.323162 Feb 15 03:07:17.621445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 268/544] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:17 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:18.640226 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:18.640953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:18.647500 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:18.647957 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:18.648758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:18.649194 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:18.887261 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:18.896050 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:18.897484 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:18.898664 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0d2af857-cb00-4c44-acc8-09e41c61f21d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.262385 Feb 15 03:07:18.899263 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 277/545] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:18 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:19.917326 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:19.917934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:19.925515 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:19.925960 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:19.926736 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:19.927184 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:20.080102 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:20.088257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:20.089778 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:20.090949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fad71879-11e4-46a8-9a44-0e479a7bae57 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.177424 Feb 15 03:07:20.091534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 269/546] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:19 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:21.109350 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:21.110012 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:21.116412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:21.116861 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:21.117640 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:21.118073 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:21.258577 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:21.267843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:21.269373 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:21.270583 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b7d901bf-653c-464c-b905-4c0cca9a39af tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.165045 Feb 15 03:07:21.271198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 278/547] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:21 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:22.289391 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:22.289975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:22.296286 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:22.296905 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:22.297717 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:22.298150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:22.454815 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:22.462918 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:22.464492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:22.465659 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a5938138-63d6-4933-8b04-0e15df454d9b tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.180179 Feb 15 03:07:22.466226 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 270/548] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:22 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:23.485018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:23.485648 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:23.492074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:23.492533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:23.493360 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:23.493818 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:23.693810 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:23.702249 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:23.704558 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:23.705845 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b7fbec6a-e684-45ff-9214-e4cf4145d477 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1744 microversion: 2.20 time: 0.225073 Feb 15 03:07:23.706425 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 279/549] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:23 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:24.725049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:24.725656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:24.732079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:24.732531 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:24.733320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:24.734381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:24.877275 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:24.885460 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:24.886970 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:24.888192 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d609b532-6b4f-477e-a147-e7a128396644 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1744 microversion: 2.20 time: 0.166944 Feb 15 03:07:24.888758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 271/550] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:24 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:25.909723 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:25.910342 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:25.917203 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:25.917659 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:25.918676 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:25.919112 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:26.081404 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:26.090564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:26.092202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:26.094226 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-219524bb-9270-4fb1-81a0-f7ea0b195e33 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.189880 Feb 15 03:07:26.095061 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 280/551] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:25 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:27.114198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:27.114990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:27.121275 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:27.122076 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:27.123111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:27.123843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:27.302866 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:27.311694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:27.314721 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:27.316694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-72cc621b-6e5e-4361-b0a5-0e136b15bca7 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.207361 Feb 15 03:07:27.317336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 272/552] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:27 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:27.827749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-7f861d3a-5951-4be1-a4f5-442227714ad2 req-2374d820-c3df-49a2-bc18-51e61312a2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "name": "network-vif-plugged", "status": "completed", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:27.832784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:07:27.832784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:07:27.852644 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7f861d3a-5951-4be1-a4f5-442227714ad2 req-2374d820-c3df-49a2-bc18-51e61312a2c9 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:27.853669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7f861d3a-5951-4be1-a4f5-442227714ad2 req-2374d820-c3df-49a2-bc18-51e61312a2c9 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:27.867326 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-7f861d3a-5951-4be1-a4f5-442227714ad2 req-2374d820-c3df-49a2-bc18-51e61312a2c9 service nova] Creating event network-vif-plugged:c54c020e-ee76-46b5-9b5c-5abb119c8f80 for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e on hv-cinder-82808 Feb 15 03:07:27.874869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-7f861d3a-5951-4be1-a4f5-442227714ad2 req-2374d820-c3df-49a2-bc18-51e61312a2c9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053619 Feb 15 03:07:27.876529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 281/553] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:07:28.336321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:28.337161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:28.345250 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:28.345714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:28.346576 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:28.347142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:28.507527 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:28.517061 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:28.519262 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:28.522822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b91c8829-fabe-46c2-811c-6606934a2e9e tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.190432 Feb 15 03:07:28.523922 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 273/554] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:28 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:29.545202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:29.547142 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:29.561993 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:29.562442 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:29.563528 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:29.564133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:29.746567 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:29.764154 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:29.767004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:29.768940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5bea6005-e889-4d96-ab28-c1c510de0fdc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.228261 Feb 15 03:07:29.770346 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 282/555] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:29 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:30.789900 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:30.790623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:30.798607 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:30.799055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:30.799921 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:30.800362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:30.984779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:30.998995 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:31.002808 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:31.004836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fd4e70c7-564f-47f9-81a8-e8cddd62f874 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.218357 Feb 15 03:07:31.015548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 274/556] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:30 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:31.639058 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:31.641233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:31.649744 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:31.650206 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:31.651699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:31.652339 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:31.693340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-30d57b15-ae93-44aa-8813-be4b22b07290 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059072 Feb 15 03:07:31.694108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 283/557] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:07:31 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:07:31.773594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:31.774442 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:31.782961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:31.783824 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:31.784870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:31.785405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:31.821692 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:07:31.924877 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-237ca439-e53f-4807-884f-64b8ad31efb0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 204 len: 0 microversion: 2.1 time: 0.155555 Feb 15 03:07:31.932836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 275/558] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:07:31 2022] DELETE /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:07:31.942631 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:31.944087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:31.955843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:31.956831 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:31.959018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:31.959921 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:32.036334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:32.037034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:32.044574 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:32.045027 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:32.045924 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:32.046962 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:32.143688 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:32.168484 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-76b18192-4670-4c25-b9d5-7d5d1c8be032 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1672 microversion: 2.1 time: 0.233408 Feb 15 03:07:32.178227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 284/559] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:31 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:32.247092 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:32.263355 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:32.267967 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:32.270241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-66e44c14-d670-4398-91c7-1a20a9b74ff8 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.237666 Feb 15 03:07:32.271898 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 276/560] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:32 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:33.186764 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:33.188091 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:33.195791 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:33.196256 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:33.197080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:33.197633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:33.292382 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:33.293653 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:33.301546 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:33.301925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:33.302926 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:33.306259 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:33.380327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:33.401928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d1258f7e-61ac-49f1-9ae4-02cc3bfeb95c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1672 microversion: 2.1 time: 0.218774 Feb 15 03:07:33.417554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 285/561] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:33 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:33.471777 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:33.484446 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:33.489324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:33.489324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bf81d9ef-f795-4fb7-9e97-d83584864a70 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.198940 Feb 15 03:07:33.489324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 277/562] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:33 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:34.430471 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:34.431093 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:34.439858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:34.440708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:34.441805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:34.442459 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:34.506132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:34.507128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:34.514251 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:34.514758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:34.522169 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:34.522638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:34.707024 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:34.719588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:34.721313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:34.724975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-74b269f2-f5f8-4f54-a2d1-cd2733dd4e94 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1739 microversion: 2.20 time: 0.219943 Feb 15 03:07:34.728492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 278/563] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:34 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:34.767361 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:34.778160 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8c268db9-97b3-49ea-81c1-53d03dfe91df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 200 len: 1672 microversion: 2.1 time: 0.352767 Feb 15 03:07:34.778755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 286/564] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:34 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 1672 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:35.033388 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-5699ba0e-81b6-4092-b914-b2a890e4f3a6 req-66db04a1-29e7-4b79-abd3-a9824ee0f3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dda008d-d3be-48d2-b87b-93c578e8d7b9", "name": "network-vif-deleted", "tag": "80804951-baf1-4d2c-b5c1-cd973c73d75f"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:35.035746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:07:35.035746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:07:35.044458 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-5699ba0e-81b6-4092-b914-b2a890e4f3a6 req-66db04a1-29e7-4b79-abd3-a9824ee0f3e6 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:35.044913 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-5699ba0e-81b6-4092-b914-b2a890e4f3a6 req-66db04a1-29e7-4b79-abd3-a9824ee0f3e6 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:35.058055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-5699ba0e-81b6-4092-b914-b2a890e4f3a6 req-66db04a1-29e7-4b79-abd3-a9824ee0f3e6 service nova] Creating event network-vif-deleted:80804951-baf1-4d2c-b5c1-cd973c73d75f for instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 on hv-cinder-82808 Feb 15 03:07:35.064178 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-5699ba0e-81b6-4092-b914-b2a890e4f3a6 req-66db04a1-29e7-4b79-abd3-a9824ee0f3e6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035565 Feb 15 03:07:35.065291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 279/565] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:07:35.745883 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:35.746546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:35.754273 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:35.755004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:35.755856 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:35.756300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:35.796840 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:35.798415 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:35.804536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:35.805231 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:35.806236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:35.806861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:35.821823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] HTTP exception thrown: Instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 could not be found. Feb 15 03:07:35.822730 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Returning 404 to user: Instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:07:35.823803 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e7e3797b-fd83-4e3a-9f8b-b3625ae3b2fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 404 len: 111 microversion: 2.1 time: 0.031789 Feb 15 03:07:35.828943 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 280/566] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:35 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 03:07:35.833746 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-74d1b2d0-31a6-4386-9d21-d39b01c3cfa3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '.version_select at 0x7fe7518b1d30>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:35.852534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-74d1b2d0-31a6-4386-9d21-d39b01c3cfa3 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071933334" status: 202 len: 0 microversion: 2.1 time: 0.022145 Feb 15 03:07:35.853463 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 281/567] 10.222.0.24 () {58 vars in 1220 bytes} [Tue Feb 15 03:07:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071933334 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:07:36.285896 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:36.298143 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:36.300091 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:36.301709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-387715d4-ae4a-4106-ac34-9340a34ad372 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1721 microversion: 2.20 time: 0.559545 Feb 15 03:07:36.302778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 287/568] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:35 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1721 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:36.578508 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ee8ab558-507a-4e3c-abc0-42c1bbf62c6a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: .version_select at 0x7fe7518a7f70>, body: {"keypair": {"name": "tempest-keypair-1502714621"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:36.602604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-ee8ab558-507a-4e3c-abc0-42c1bbf62c6a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:07:36.609988 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-ee8ab558-507a-4e3c-abc0-42c1bbf62c6a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for user c432dc1a98af4de28833f18c3b7ff6f8 and project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:07:36.791692 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-ee8ab558-507a-4e3c-abc0-42c1bbf62c6a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:07:36.795659 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-ee8ab558-507a-4e3c-abc0-42c1bbf62c6a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for user c432dc1a98af4de28833f18c3b7ff6f8 and project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:07:36.808278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ee8ab558-507a-4e3c-abc0-42c1bbf62c6a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.237218 Feb 15 03:07:36.809031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 282/569] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Feb 15 03:07:36 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:36.899313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:36.899927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:36.906516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:36.906961 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:36.907760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:36.908198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:36.934487 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lazy-loading 'flavor' on Instance uuid e816e723-cdff-4e33-91d5-f2225b504193 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:07:37.012047 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8cd27aab-a7ab-4c82-8754-a8c5bafd0e12 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "POST /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193/action" status: 202 len: 0 microversion: 2.1 time: 0.116263 Feb 15 03:07:37.012796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 288/570] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:07:36 2022] POST /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:07:37.023092 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:37.023741 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:37.030170 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:37.031500 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:37.032264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:37.032703 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:37.242510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:37.251808 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-588d974a-34f9-454d-aa1b-bdaf1c47d4bc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.232862 Feb 15 03:07:37.252449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 283/571] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:37 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:37.323123 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:37.323840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:37.330674 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:37.331117 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:37.331922 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:37.332353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:37.536710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:37.544912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:37.546446 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:37.547685 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9b0c35ee-0a3c-45fe-b298-aa7a4d6eaa81 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1721 microversion: 2.20 time: 0.228836 Feb 15 03:07:37.548312 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 289/572] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:37 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:38.268823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:38.269561 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:38.276023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.276558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.277439 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.277944 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.310546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1687184832", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09e6f2a7-989f-47d7-86f1-8f00da6255c2"}], "security_groups": [{"name": "tempest-securitygroup--979727429"}], "key_name": "tempest-keypair-1502714621", "user_data": "}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:38.419199 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:38.424761 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] validate_networks() for [('09e6f2a7-989f-47d7-86f1-8f00da6255c2', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:07:38.431566 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-76a6debf-f8d3-48dc-a1ae-c8c33fa4ff80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.166496 Feb 15 03:07:38.432159 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 284/573] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:38 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:38.569016 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:38.570200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:38.581081 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.581899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.583377 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.584311 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.761516 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:38.772150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:38.773690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:38.774905 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3f255533-81db-4a6c-a621-61661ff08f29 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1664 microversion: 2.20 time: 0.212671 Feb 15 03:07:38.775540 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 285/574] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:38 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:38.792688 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57eab931-fb93-464b-836c-dd9ed049ed15"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:38.793802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:38.800481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.800940 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.801869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.802201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.883460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:07:38.883879 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:07:38.884379 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:07:38.884782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:07:38.885191 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:07:38.894957 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.896025 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.896371 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:38.896663 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:38.913618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:07:38.917752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Getting quotas for user c432dc1a98af4de28833f18c3b7ff6f8 and project 4b24450db43141d59e07c9aeed3a9a68. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:07:38.929928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:07:38.932366 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:07:38.989485 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-354caad9-468c-4b15-a77d-7d0c689b90bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682929 Feb 15 03:07:38.997374 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 290/575] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:07:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 03:07:39.004040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-aa835f5f-121d-4f69-8149-1152d8dfc1fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:39.004910 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-aa835f5f-121d-4f69-8149-1152d8dfc1fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:39.072105 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-aa835f5f-121d-4f69-8149-1152d8dfc1fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:39.080205 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-aa835f5f-121d-4f69-8149-1152d8dfc1fb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1238 microversion: 2.1 time: 0.081230 Feb 15 03:07:39.091001 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 291/576] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:38 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:39.142042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-671d35dc-18d0-4ac0-9261-6046490f7794 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.352392 Feb 15 03:07:39.143289 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 286/577] 10.222.0.24 () {62 vars in 1363 bytes} [Tue Feb 15 03:07:38 2022] POST /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 15 03:07:39.260491 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:39.260988 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:39.267280 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.267728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.268514 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.268944 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.449463 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:39.450215 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:39.458263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.458875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.461034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.461034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.536708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a8bf35c4-5e65-4c92-88f3-62b78a321aa5 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-volume_attachments/57eab931-fb93-464b-836c-dd9ed049ed15" status: 202 len: 0 microversion: 2.20 time: 0.279892 Feb 15 03:07:39.537669 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 292/578] 10.222.0.24 () {60 vars in 1456 bytes} [Tue Feb 15 03:07:39 2022] DELETE /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-volume_attachments/57eab931-fb93-464b-836c-dd9ed049ed15 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:07:39.654348 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:39.663372 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5f668ac2-d245-4e00-84e3-2b02ea955130 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.217639 Feb 15 03:07:39.664156 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 287/579] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:39 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:39.795507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:39.796436 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:39.804323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.805040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.806056 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.806710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.860962 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-5f546c4e-8ac7-4ef0-a365-3d57d1afeb4e req-e143ce73-6982-4165-a325-e487f075798d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "name": "network-vif-unplugged", "status": "completed", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:39.862954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:07:39.862954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:07:39.878263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-5f546c4e-8ac7-4ef0-a365-3d57d1afeb4e req-e143ce73-6982-4165-a325-e487f075798d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.879589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-5f546c4e-8ac7-4ef0-a365-3d57d1afeb4e req-e143ce73-6982-4165-a325-e487f075798d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.896211 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.compute.server_external_events [req-5f546c4e-8ac7-4ef0-a365-3d57d1afeb4e req-e143ce73-6982-4165-a325-e487f075798d service nova] Unable to find a host for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e. Dropping event network-vif-unplugged {{(pid=116501) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 15 03:07:39.897281 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-5f546c4e-8ac7-4ef0-a365-3d57d1afeb4e req-e143ce73-6982-4165-a325-e487f075798d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044664 Feb 15 03:07:39.898020 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 288/580] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 15 03:07:39.924881 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dd1907f4-e853-4e46-bdf0-b7e8ce5df85f tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "POST /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/action" status: 202 len: 0 microversion: 2.20 time: 0.133306 Feb 15 03:07:39.925733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 293/581] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Feb 15 03:07:39 2022] POST /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:07:39.936378 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:39.937396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:39.945035 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.945764 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:39.946634 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:39.947143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:40.098340 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:40.099809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:40.100893 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:40.106956 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:40.107412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:40.107865 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:40.108647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:40.108811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:40.109899 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:40.110721 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5e8dfe30-d474-4a5c-a661-a821c5001c9a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1672 microversion: 2.20 time: 0.178667 Feb 15 03:07:40.111464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 289/582] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:39 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:40.175654 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:40.184813 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d924fc78-57a2-4f9d-a010-1e6777d94146 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1290 microversion: 2.1 time: 0.090839 Feb 15 03:07:40.185386 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 294/583] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:40 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:40.681939 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:40.682589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:40.689780 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:40.690233 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:40.691035 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:40.691507 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:40.854649 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:40.864078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-15c5745f-bb5c-462c-b0eb-51abc205c001 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.185030 Feb 15 03:07:40.864721 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 290/584] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:40 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:41.133621 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:41.135906 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:41.148311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:41.149196 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:41.150527 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:41.152540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:41.202901 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:41.205435 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:41.217421 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:41.217913 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:41.218868 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:41.219958 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:41.389201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:41.398082 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e4108e9d-58c7-4dff-9340-b76bf3752832 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.199762 Feb 15 03:07:41.398773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 291/585] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:41 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:41.480070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:41.488621 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:41.490239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:41.491544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0625f0b0-ec63-4dcb-8c4e-b41707399535 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.364884 Feb 15 03:07:41.502154 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 295/586] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:41 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:41.880228 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:41.881543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:41.888461 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:41.888912 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:41.890187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:41.890628 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:42.038923 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:42.047911 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b6b73c71-fdb0-41bf-896b-95f303c93f2c tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.170994 Feb 15 03:07:42.058134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 292/587] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:41 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:42.237710 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-942cc82b-5e38-451a-8625-087120124646 req-04f96e22-c70f-4bdd-8a62-f590fec93746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92a6fac-d364-4204-833a-75679d2e833f", "tag": "b9a649f9-fed5-4fb8-833f-5f3e5a7d43db"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:42.239438 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:07:42.239438 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:07:42.252373 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-942cc82b-5e38-451a-8625-087120124646 req-04f96e22-c70f-4bdd-8a62-f590fec93746 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:42.252826 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-942cc82b-5e38-451a-8625-087120124646 req-04f96e22-c70f-4bdd-8a62-f590fec93746 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:42.265108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-942cc82b-5e38-451a-8625-087120124646 req-04f96e22-c70f-4bdd-8a62-f590fec93746 service nova] Creating event network-changed:b9a649f9-fed5-4fb8-833f-5f3e5a7d43db for instance e92a6fac-d364-4204-833a-75679d2e833f on hv-cinder-82808 Feb 15 03:07:42.271087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-942cc82b-5e38-451a-8625-087120124646 req-04f96e22-c70f-4bdd-8a62-f590fec93746 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123592 Feb 15 03:07:42.271778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 296/588] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:07:42.415366 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:42.415919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:42.422239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:42.423139 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:42.424174 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:42.424603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:42.516579 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:42.517793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:42.530055 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:42.531578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:42.534861 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:42.536313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:42.621901 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:42.630486 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bacc58ff-008d-4131-ab8f-4a9002a6ce49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.218783 Feb 15 03:07:42.631767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 293/589] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:42 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:42.821580 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:42.830330 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:42.832108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:42.834037 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7ea09344-4d62-4404-891e-5f890a6bde0a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.326617 Feb 15 03:07:42.834842 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 297/590] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:42 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:43.066006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:43.066565 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:43.073371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:43.074071 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:43.075110 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:43.075737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:43.244533 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:43.253870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f4b260f6-9494-463a-a9c3-90eed8514edc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.192115 Feb 15 03:07:43.254456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 294/591] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:43 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:43.648206 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:43.650175 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:43.662400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:43.663292 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:43.664858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:43.665746 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:43.835530 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:43.845507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-04dc648f-117a-473e-80af-0b640c4f02ed tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.200609 Feb 15 03:07:43.847187 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 298/592] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:43 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:43.852772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:43.853536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:43.860389 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:43.860839 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:43.861624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:43.862121 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:44.029535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:44.042541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:44.045158 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:44.046371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-2e335668-720a-4a31-aaa4-9d823e8e4cca tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.197155 Feb 15 03:07:44.047764 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 295/593] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:43 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:44.272278 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:44.272825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:44.279022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:44.279753 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:44.280753 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:44.281912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:44.462179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:44.470636 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1d0c0f31-7b38-4902-813d-f9c9981c14a2 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.202089 Feb 15 03:07:44.471244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 299/594] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:44 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:44.862428 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:44.863067 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:44.869867 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:44.870647 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:44.871496 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:44.871942 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:45.021532 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:45.029255 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b1b50c3d-c90c-47fb-85f0-bd939ff7f0aa tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.171094 Feb 15 03:07:45.029761 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 296/595] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:44 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:45.065952 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:45.066590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:45.073716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:45.074195 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:45.074981 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:45.075472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:45.233557 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:45.241660 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:45.243202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:45.244396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5610f01a-f0eb-43b5-8896-9c1d61c9c1e0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.182408 Feb 15 03:07:45.244979 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 300/596] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:45 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:45.487850 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:45.488319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:45.494923 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:45.495510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:45.506851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:45.507502 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:45.662202 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:45.670498 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-452f62c6-68c4-4d76-9562-df098068c8db tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.186635 Feb 15 03:07:45.671845 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 297/597] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:45 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:46.047264 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:46.048038 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:46.054565 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:46.055261 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:46.059426 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:46.059891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:46.233457 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:46.242801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1d487d4d-b5c8-4b15-8289-a97aaa51fb40 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.199795 Feb 15 03:07:46.247446 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 301/598] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:46 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:46.269541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:46.270770 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:46.280134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:46.280675 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:46.282298 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:46.282849 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:46.450163 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:46.462405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:46.463965 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:46.465173 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-80669c7c-02c4-4e5c-8a38-dd362b3e62d3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.203655 Feb 15 03:07:46.465939 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 298/599] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:46 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:46.696655 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:46.697708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:46.705053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:46.705925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:46.707040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:46.707581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:46.858911 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:46.866564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b5fb2697-661c-4c53-b905-f3cfc30f4660 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.173693 Feb 15 03:07:46.867126 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 302/600] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:46 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:47.259730 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:47.260393 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:47.266627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:47.267115 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:47.267933 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:47.268517 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:47.412615 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:47.420203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-46780069-5202-4bb1-8435-0a77a362e0ab tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.164151 Feb 15 03:07:47.430829 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 299/601] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:47 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:47.486583 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:47.487277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:47.494054 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:47.494515 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:47.495380 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:47.495821 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:47.662464 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:47.671420 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:47.673572 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:47.674758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-46d9eb44-cc51-498e-9f24-7e2be43193fa tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.193232 Feb 15 03:07:47.675352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 303/602] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:47 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:47.884443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:47.884975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:47.891047 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:47.891560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:47.892371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:47.892777 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:48.054929 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:48.063712 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7f718bee-db00-4dc2-9dcb-6230014885fa tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.183008 Feb 15 03:07:48.064302 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 300/603] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:47 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:48.437816 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:48.439264 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:48.445875 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:48.446420 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:48.447330 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:48.447841 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:48.656146 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:48.665794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7f419010-cf42-47c5-918a-ee296f2d309a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.231573 Feb 15 03:07:48.667026 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 304/604] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:48 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:48.693531 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:48.694243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:48.702958 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:48.703464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:48.706059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:48.706561 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:49.000667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:49.010644 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:49.012461 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:49.014041 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-016a7c65-b3f2-4daa-b83c-a1b3347e2123 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.324226 Feb 15 03:07:49.025260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 301/605] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:48 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:49.081325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:49.081952 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:49.088782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:49.089663 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:49.090742 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:49.091594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:49.279417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:49.288802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3075976f-648f-4985-babf-5831d8b4fbbc tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.210992 Feb 15 03:07:49.298929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 305/606] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:49 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:49.683751 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:49.684367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:49.690964 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:49.691449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:49.692252 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:49.692697 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:49.859655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:49.867945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-39bbf449-b4e4-4125-b00b-09ebcbe5d2bc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.187845 Feb 15 03:07:49.868530 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 302/607] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:49 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:50.036288 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:50.038369 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:50.044945 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:50.045396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:50.046225 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:50.046668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:50.199622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:50.207416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:50.209518 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:50.211041 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-09641d43-c686-466b-8b3d-fe1e7c35b2a0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.179793 Feb 15 03:07:50.223678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 306/608] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:50 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:50.308873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:50.310006 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:50.322321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:50.323108 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:50.324491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:50.325386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:50.471770 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:50.479786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fc6925cb-5396-45be-af6b-ee88fa38311b tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.177416 Feb 15 03:07:50.489673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 303/609] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:50 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:50.885591 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:50.886198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:50.892255 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:50.892708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:50.893615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:50.894088 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:51.070084 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:51.078029 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b67b2c24-de08-43d4-a9db-14a410f5f89e tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.195927 Feb 15 03:07:51.084950 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 307/610] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:50 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:51.231333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:51.232033 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:51.239206 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:51.239657 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:51.240449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:51.240885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:51.386236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:51.394480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:51.396012 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:51.397172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-74920cea-e84c-417e-add9-bdd001647770 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.169745 Feb 15 03:07:51.397735 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 304/611] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:51 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:51.496933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:51.497576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:51.504128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:51.504578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:51.505364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:51.505794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:52.018609 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:52.026113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0a55446f-c388-4a0a-a207-fd9031a429b9 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.532838 Feb 15 03:07:52.026693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 308/612] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:51 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:52.101646 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:52.102161 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:52.108141 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:52.108674 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:52.109528 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:52.110092 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:52.252014 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:52.259264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d0707abc-79dd-4f71-98cb-547cc0b51e1b tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.161299 Feb 15 03:07:52.259826 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 305/613] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:52 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:52.416291 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:52.416908 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:52.423353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:52.423812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:52.424603 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:52.425050 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:52.570268 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:52.578757 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:52.580785 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:52.582070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8117b7f2-cb72-460e-8410-182efa9d0b12 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.169440 Feb 15 03:07:52.582635 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 309/614] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:52 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:53.043665 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:53.044278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:53.050827 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:53.051321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:53.052105 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:53.052544 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:53.186575 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:53.194085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e709601e-6bdf-4776-b97f-9e4e258117f0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.154081 Feb 15 03:07:53.194672 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 306/615] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:53 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:53.276454 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:53.277058 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:53.283732 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:53.284178 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:53.284947 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:53.285378 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:53.418458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:53.426080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fd81ae80-ff8a-4d14-a842-44bcf8ad20f5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.153280 Feb 15 03:07:53.426657 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 310/616] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:53 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:53.600798 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:53.601439 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:53.607925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:53.608377 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:53.609148 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:53.609582 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:53.762786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:53.775328 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:53.777032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:53.778285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-385aeba2-0b5c-464a-8e9d-f12266b75f59 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.181206 Feb 15 03:07:53.778977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 307/617] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:53 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:54.210674 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:54.211327 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:54.217519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.217975 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.218764 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.219229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.358496 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:54.366515 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-241b4358-ea57-41fa-bf1a-aa5c35538ee0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1571 microversion: 2.1 time: 0.159408 Feb 15 03:07:54.367141 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 311/618] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:54 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:54.383345 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:54.384152 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:54.390856 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.391695 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.392830 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.393396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.441843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:54.442390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:54.448781 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.449190 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.449977 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.450418 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.541775 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a8d1c4e1-5d37-44c9-9ca7-2e0d8f040ea0 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "POST /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193/action" status: 202 len: 0 microversion: 2.1 time: 0.162456 Feb 15 03:07:54.548698 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 308/619] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:07:54 2022] POST /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:07:54.558897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:54.562291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:54.576814 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.577642 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.578769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.582815 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.617844 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:54.626444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3a9f84df-958e-408e-aa3f-ac8ebb6096b8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.187791 Feb 15 03:07:54.627560 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 312/620] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:54 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:54.748655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:54.757131 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d7c72553-0c03-4048-82ce-5657d366019f tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1519 microversion: 2.1 time: 0.206379 Feb 15 03:07:54.757699 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 309/621] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:54 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:54.796923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:54.797535 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:54.804252 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.804704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.808016 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:54.808576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:54.958716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:54.968778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:54.970709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:54.972407 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d564c15a-2775-4b31-91a0-a80dadee0bcb tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.179077 Feb 15 03:07:54.972971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 313/622] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:54 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:55.644828 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:55.645465 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:55.652495 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:55.652945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:55.653723 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:55.654160 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:55.773984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:55.774607 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:55.781052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:55.781500 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:55.782885 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:55.783404 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:55.803956 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:55.811419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ab04a42d-509a-454d-ac3d-c32ffc91714a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.171347 Feb 15 03:07:55.811997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 310/623] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:55 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:55.931801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:55.941625 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d7c3b30b-722c-4f5b-9b02-b679c52f4532 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.171462 Feb 15 03:07:55.943460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 314/624] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:55 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:55.971983 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-8968aadd-2d5c-49e1-922e-92e4fc8d3b2e req-41fe87f4-30f3-4998-aca6-433a168857c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "name": "network-vif-plugged", "status": "completed", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:55.973694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:07:55.973694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:07:55.981024 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-8968aadd-2d5c-49e1-922e-92e4fc8d3b2e req-41fe87f4-30f3-4998-aca6-433a168857c4 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:55.981476 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-8968aadd-2d5c-49e1-922e-92e4fc8d3b2e req-41fe87f4-30f3-4998-aca6-433a168857c4 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:55.990504 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:55.991439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:55.994480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-8968aadd-2d5c-49e1-922e-92e4fc8d3b2e req-41fe87f4-30f3-4998-aca6-433a168857c4 service nova] Creating event network-vif-plugged:c54c020e-ee76-46b5-9b5c-5abb119c8f80 for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e on hv-cinder-82808 Feb 15 03:07:55.999110 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:56.000601 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-8968aadd-2d5c-49e1-922e-92e4fc8d3b2e req-41fe87f4-30f3-4998-aca6-433a168857c4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099059 Feb 15 03:07:56.001459 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:56.002332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 311/625] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:07:56.002840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:56.003624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:56.283724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:56.292298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:56.294042 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:56.295283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-440a89ce-78f1-40e9-830c-177935e5aae1 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.309139 Feb 15 03:07:56.296053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 315/626] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:55 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:56.830155 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:56.830972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:56.837308 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:56.837766 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:56.838624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:56.839009 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:56.960167 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:56.960787 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:56.967020 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:56.967578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:56.968362 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:56.968800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:56.976607 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:56.983731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-233435d6-36cf-453f-be43-2790444082e8 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.158174 Feb 15 03:07:56.984310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 312/627] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:56 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:57.105254 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:57.112835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-df4d6892-fa17-4807-aa83-ea3840f33399 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.156339 Feb 15 03:07:57.113410 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 316/628] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:56 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:57.314472 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:57.315074 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:57.321152 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:57.321596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:57.322369 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:57.322799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:57.473593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:57.482366 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:57.483996 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:57.486171 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ab5f4599-28a2-4f68-9a8f-c52e1f6ec43a tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1730 microversion: 2.20 time: 0.174999 Feb 15 03:07:57.497218 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 313/629] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:57 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:07:58.001995 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:58.002561 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:58.009094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.009733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.010532 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.010971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.015861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-c20f9a42-d2b3-45e4-97d9-2cdc12a8945e req-73a83b32-f669-423e-8377-9828273b69cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92a6fac-d364-4204-833a-75679d2e833f", "name": "network-vif-plugged", "status": "completed", "tag": "b9a649f9-fed5-4fb8-833f-5f3e5a7d43db"}, {"server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "name": "network-vif-unplugged", "status": "completed", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:07:58.019127 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:07:58.019127 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:07:58.028017 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c20f9a42-d2b3-45e4-97d9-2cdc12a8945e req-73a83b32-f669-423e-8377-9828273b69cd service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.028466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c20f9a42-d2b3-45e4-97d9-2cdc12a8945e req-73a83b32-f669-423e-8377-9828273b69cd service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.042565 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-c20f9a42-d2b3-45e4-97d9-2cdc12a8945e req-73a83b32-f669-423e-8377-9828273b69cd service nova] Creating event network-vif-plugged:b9a649f9-fed5-4fb8-833f-5f3e5a7d43db for instance e92a6fac-d364-4204-833a-75679d2e833f on hv-cinder-82808 Feb 15 03:07:58.043076 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-c20f9a42-d2b3-45e4-97d9-2cdc12a8945e req-73a83b32-f669-423e-8377-9828273b69cd service nova] Creating event network-vif-unplugged:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:07:58.050757 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-c20f9a42-d2b3-45e4-97d9-2cdc12a8945e req-73a83b32-f669-423e-8377-9828273b69cd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038746 Feb 15 03:07:58.051400 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 314/630] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:07:58.134899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:58.135637 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:58.142732 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.143209 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.144079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.144706 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.167335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:58.176283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1bd8db9b-2c2d-420c-a20d-12d109790782 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.177801 Feb 15 03:07:58.178098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 317/631] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:57 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:58.300457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:58.307951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3b28b42f-1fe3-49f2-8e20-953606b288ca tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.181774 Feb 15 03:07:58.308524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 315/632] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:58 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:07:58.505594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:58.506210 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:58.512253 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.512708 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.513488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:58.513926 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:58.652240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:58.660176 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:58.661702 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:58.662870 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-88dbb7b9-2096-4977-9f6b-068354eb5cc4 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1717 microversion: 2.20 time: 0.161962 Feb 15 03:07:58.663470 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 318/633] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:07:58 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:07:59.194672 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:59.195786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:59.202334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:59.202786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:59.203652 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:59.204087 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:59.325105 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:07:59.325833 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:07:59.332968 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:59.333518 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:59.334563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:07:59.335007 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:07:59.354764 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:59.370776 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-baf7ee7e-c30d-46e0-bb69-6b8bed85fd9a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1363 microversion: 2.1 time: 0.179732 Feb 15 03:07:59.372159 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 316/634] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:59 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:07:59.491236 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:07:59.498990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-36eddd4c-e40a-45a9-962e-d373d87e6ec3 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.177558 Feb 15 03:07:59.499626 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 319/635] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:07:59 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:08:00.387663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:00.388265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:00.395174 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:00.395638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:00.396440 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:00.396872 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:00.516194 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:00.516805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:00.523529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:00.524095 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:00.524951 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:00.525483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:00.536913 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:00.544437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f09123f2-96a1-4cce-b0f4-e370ced10fdc tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1548 microversion: 2.1 time: 0.160430 Feb 15 03:08:00.545203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 317/636] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:00 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:00.560920 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:00.561413 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:00.568286 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:00.568744 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:00.569579 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:00.570007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:00.654443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3c75b221-2823-46d3-a0ff-6eb3af863db2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097007 Feb 15 03:08:00.655244 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 318/637] 10.222.0.24 () {58 vars in 1274 bytes} [Tue Feb 15 03:08:00 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:08:00.662778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:00.670367 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ff2423e8-3bf5-4798-bb9d-3fff1777c518 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.158010 Feb 15 03:08:00.670933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 320/638] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:00 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:01.659851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:01.660655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:01.664339 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-cfd80449-fb25-4474-ad39-0506d3b82af3 req-d9ce1d64-fb72-4231-ac95-36047c9017a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92a6fac-d364-4204-833a-75679d2e833f", "tag": "b9a649f9-fed5-4fb8-833f-5f3e5a7d43db"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:01.666774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:08:01.666774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:08:01.667203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:01.667663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:01.668461 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:01.668897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:01.674903 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-cfd80449-fb25-4474-ad39-0506d3b82af3 req-d9ce1d64-fb72-4231-ac95-36047c9017a5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:01.675379 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-cfd80449-fb25-4474-ad39-0506d3b82af3 req-d9ce1d64-fb72-4231-ac95-36047c9017a5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:01.687784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-cfd80449-fb25-4474-ad39-0506d3b82af3 req-d9ce1d64-fb72-4231-ac95-36047c9017a5 service nova] Creating event network-changed:b9a649f9-fed5-4fb8-833f-5f3e5a7d43db for instance e92a6fac-d364-4204-833a-75679d2e833f on hv-cinder-82808 Feb 15 03:08:01.693532 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-cfd80449-fb25-4474-ad39-0506d3b82af3 req-d9ce1d64-fb72-4231-ac95-36047c9017a5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032681 Feb 15 03:08:01.694303 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 321/639] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:01.699525 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:01.700228 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:01.705154 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-434f5313-157c-4745-a301-b9ff3a98c17a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/ips" status: 200 len: 105 microversion: 2.1 time: 0.049977 Feb 15 03:08:01.706151 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 319/640] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Feb 15 03:08:01 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/ips => generated 105 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:01.712609 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:01.713071 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:01.714007 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:01.714453 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:01.963204 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:01.975954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ed27667c-babb-4e64-be5a-1f8e035abf80 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.280417 Feb 15 03:08:01.977720 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 322/641] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:01 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:02.999259 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:03.000557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:03.011751 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:03.012552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:03.013975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:03.014790 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:03.189675 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de4334cd-81a8-4558-93bd-b7516e77fde4"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:03.192713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:03.203891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:03.204350 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:03.206436 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:03.206895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:03.227870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:03.241091 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e6432cfb-693b-4578-94f1-a3280b26b6c6 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1577 microversion: 2.1 time: 0.249039 Feb 15 03:08:03.242385 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 320/642] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:02 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:03.458270 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-257f90f8-69c7-43d7-abae-373d508f1b52 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275744 Feb 15 03:08:03.458974 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 323/643] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:08:03 2022] POST /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:04.259521 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:04.260134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:04.266770 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:04.267818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:04.268916 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:04.269381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:04.431655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:04.440477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0f551966-1501-46e6-8833-851f927dd4ce tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1564 microversion: 2.1 time: 0.184324 Feb 15 03:08:04.441076 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 321/644] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:04 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:05.898645 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-d3e14e44-730a-4b0d-a150-6e7ca19bc111 req-0eae33f0-ce48-4c84-8e8c-e7eb0b3cd954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "name": "network-vif-plugged", "status": "completed", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:05.900225 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:08:05.900225 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:08:05.908804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-d3e14e44-730a-4b0d-a150-6e7ca19bc111 req-0eae33f0-ce48-4c84-8e8c-e7eb0b3cd954 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:05.909522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-d3e14e44-730a-4b0d-a150-6e7ca19bc111 req-0eae33f0-ce48-4c84-8e8c-e7eb0b3cd954 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:05.921144 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-d3e14e44-730a-4b0d-a150-6e7ca19bc111 req-0eae33f0-ce48-4c84-8e8c-e7eb0b3cd954 service nova] Creating event network-vif-plugged:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:08:05.927659 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-d3e14e44-730a-4b0d-a150-6e7ca19bc111 req-0eae33f0-ce48-4c84-8e8c-e7eb0b3cd954 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Feb 15 03:08:05.928277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 324/645] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:09.950666 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:09.951683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:09.958673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:09.959058 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:09.959908 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:09.960348 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:09.996932 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-92913025-3ac1-40fd-81fd-28fc74527fc0 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050082 Feb 15 03:08:09.997522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 322/646] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:08:09 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:10.009184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:10.009774 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:10.016629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:10.017161 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:10.018691 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:10.019136 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:10.053279 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-54a8bd6c-c050-4548-b584-cf89d64c8e2c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/de4334cd-81a8-4558-93bd-b7516e77fde4" status: 200 len: 194 microversion: 2.1 time: 0.048016 Feb 15 03:08:10.054534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 325/647] 10.222.0.24 () {58 vars in 1412 bytes} [Tue Feb 15 03:08:10 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/de4334cd-81a8-4558-93bd-b7516e77fde4 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:11.385814 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f043eb2-1761-49ae-961d-5bc3a487faa3"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:11.386873 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:11.393402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:11.393857 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:11.394638 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:11.395077 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:11.626030 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4e63d758-b8c1-42ed-96cc-327ed95a3e49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "POST /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243776 Feb 15 03:08:11.626671 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 323/648] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:08:11 2022] POST /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:19.105570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:19.106981 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:19.113625 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:19.114058 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:19.114852 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:19.115360 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:19.145744 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ef05c0ca-d4ce-40d8-9420-91c01b9f0a49 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043910 Feb 15 03:08:19.146322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 326/649] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:08:19 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:36.069930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:36.070530 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:36.077194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:36.077645 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:36.078424 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:36.078861 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:36.108637 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-51b792f1-433d-49bb-9c59-7924498b3beb tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/de4334cd-81a8-4558-93bd-b7516e77fde4" status: 200 len: 194 microversion: 2.1 time: 0.042794 Feb 15 03:08:36.109208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 324/650] 10.222.0.24 () {58 vars in 1412 bytes} [Tue Feb 15 03:08:36 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/de4334cd-81a8-4558-93bd-b7516e77fde4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:36.118954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:36.119522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:36.125778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:36.126233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:36.127014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:36.127497 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:36.210161 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lazy-loading 'services' on Instance uuid e92a6fac-d364-4204-833a-75679d2e833f {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:08:36.283947 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fc6ed5f6-6870-4989-97f1-94b0d2d3b718 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/de4334cd-81a8-4558-93bd-b7516e77fde4" status: 202 len: 0 microversion: 2.1 time: 0.168807 Feb 15 03:08:36.284792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 327/651] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:08:36 2022] DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/de4334cd-81a8-4558-93bd-b7516e77fde4 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:08:37.079236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:37.080437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:37.086917 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.087779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.088534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.088973 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.120558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b91df915-520d-4359-a23e-76611ef23fc3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045958 Feb 15 03:08:37.121136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 325/652] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Feb 15 03:08:37 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:37.177317 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:37.177892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:37.186015 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.186503 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.187482 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.187979 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.215400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:08:37.296288 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-78648b82-319f-487e-b835-055269934124 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 204 len: 0 microversion: 2.20 time: 0.122607 Feb 15 03:08:37.296790 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 328/653] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Feb 15 03:08:37 2022] DELETE /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 15 03:08:37.304729 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:37.305335 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:37.316397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.316853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.317833 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.318347 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.401018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:37.401617 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:37.407776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.408258 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.409052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.409488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.440154 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-adc948a2-571f-4db0-8346-525e5b2782f2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/8f043eb2-1761-49ae-961d-5bc3a487faa3" status: 200 len: 194 microversion: 2.1 time: 0.045477 Feb 15 03:08:37.445052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 329/654] 10.222.0.24 () {58 vars in 1412 bytes} [Tue Feb 15 03:08:37 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/8f043eb2-1761-49ae-961d-5bc3a487faa3 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:37.450040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:37.450535 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:37.456264 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.456731 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.457495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:37.457931 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:37.468989 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:37.477111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:37.479268 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:37.480429 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8ff0fd6f-59e3-4f7c-b097-55ec6dd962f9 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.179397 Feb 15 03:08:37.480990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 326/655] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:08:37 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:08:37.535096 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lazy-loading 'services' on Instance uuid e92a6fac-d364-4204-833a-75679d2e833f {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:08:37.604160 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dfcb6c8f-5f68-4304-bc73-ba7cf7358c6c tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/8f043eb2-1761-49ae-961d-5bc3a487faa3" status: 202 len: 0 microversion: 2.1 time: 0.156570 Feb 15 03:08:37.604756 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 330/656] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:08:37 2022] DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments/8f043eb2-1761-49ae-961d-5bc3a487faa3 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:08:38.498825 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:38.499450 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:38.505605 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:38.506047 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:38.506810 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:38.507276 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:38.643043 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:38.651651 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:38.653194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:38.654370 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bef308e0-4333-41a1-9a83-8626a95f02e2 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1723 microversion: 2.20 time: 0.159270 Feb 15 03:08:38.654929 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 327/657] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:08:38 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 15 03:08:38.757724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:38.758823 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:38.766073 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:38.766554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:38.767392 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:38.767839 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:38.798137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9e95c6cd-3c8a-483d-8199-5ea16eee9bda tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044944 Feb 15 03:08:38.798700 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 331/658] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:08:38 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:08:38.901032 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:38.901956 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:38.907794 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:38.908240 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:38.909016 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:38.909459 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:38.938168 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d88148a6-4b9f-4567-8c9f-2d383cff02ae tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041211 Feb 15 03:08:38.938647 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 328/659] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:08:38 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:08:38.996487 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:38.997023 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:39.003124 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:39.003620 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:39.004428 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:39.004869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:39.032243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:08:39.113849 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5b12e64f-84fa-4f9a-8ea0-8e03dc6d669a tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 204 len: 0 microversion: 2.1 time: 0.121494 Feb 15 03:08:39.114901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 332/660] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:08:38 2022] DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:08:39.123656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:39.124264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:39.130500 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:39.131048 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:39.132012 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:39.132453 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:39.275026 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:39.282364 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-aa285d3a-3ba8-44b5-a062-1254096f0688 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1673 microversion: 2.1 time: 0.162561 Feb 15 03:08:39.282935 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 329/661] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:39 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:39.673040 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:39.673739 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:39.679598 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:39.680061 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:39.680880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:39.681615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:39.777850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:39.785841 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:39.787396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7df8d655a1264611a45016ecc787871e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08d74d0cb140cfa09ddc3f8102b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:39.788564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6946487c-5600-43d3-b0b5-0d7b7947b072 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 200 len: 1657 microversion: 2.20 time: 0.119711 Feb 15 03:08:39.789137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 333/662] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:08:39 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 1657 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 15 03:08:40.014736 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-eba73a70-0cc8-4d12-9e25-0dd51cda5ece req-4bea04bd-4c98-452e-aaa4-ec3b36b6280c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e", "name": "network-vif-deleted", "tag": "c54c020e-ee76-46b5-9b5c-5abb119c8f80"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:40.016595 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:08:40.016595 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:08:40.028139 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-eba73a70-0cc8-4d12-9e25-0dd51cda5ece req-4bea04bd-4c98-452e-aaa4-ec3b36b6280c service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:40.028625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-eba73a70-0cc8-4d12-9e25-0dd51cda5ece req-4bea04bd-4c98-452e-aaa4-ec3b36b6280c service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:40.048912 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-eba73a70-0cc8-4d12-9e25-0dd51cda5ece req-4bea04bd-4c98-452e-aaa4-ec3b36b6280c service nova] Creating event network-vif-deleted:c54c020e-ee76-46b5-9b5c-5abb119c8f80 for instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e on hv-cinder-82808 Feb 15 03:08:40.054667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-eba73a70-0cc8-4d12-9e25-0dd51cda5ece req-4bea04bd-4c98-452e-aaa4-ec3b36b6280c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050068 Feb 15 03:08:40.056626 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 330/663] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:40.300353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:40.300891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:40.307389 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:40.307846 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:40.308643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:40.309076 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:40.443418 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:40.456037 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5c5e24bc-68c2-48fc-b812-b27bc3c5dfa5 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1673 microversion: 2.1 time: 0.159423 Feb 15 03:08:40.456638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 334/664] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:40 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:40.808438 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:40.809132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:40.815863 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:40.816329 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:40.817249 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:40.817690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:40.832478 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] HTTP exception thrown: Instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e could not be found. Feb 15 03:08:40.833085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Returning 404 to user: Instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:40.833935 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b0ec4698-9f3e-4a1d-b582-6c212f684250 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 404 len: 111 microversion: 2.20 time: 0.030279 Feb 15 03:08:40.834509 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 331/665] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:08:40 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 03:08:40.842939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-93ca813e-651c-4530-8f22-64933e873db3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '.version_select at 0x7fe751872040>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:40.846629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93ca813e-651c-4530-8f22-64933e873db3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [70ea5272-e026-4783-962d-868e9a2ae008] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 15 03:08:41.473370 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:41.474079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:41.481602 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:41.482139 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:41.483054 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:41.483573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:41.625290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c432dc1a98af4de28833f18c3b7ff6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24450db43141d59e07c9aeed3a9a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:41.632760 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-55eeb3fb-0747-42cd-82b2-a50f46d3b790 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 200 len: 1673 microversion: 2.1 time: 0.163263 Feb 15 03:08:41.633702 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 332/666] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:41 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:08:41.855802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO oslo.messaging._drivers.impl_rabbit [None req-93ca813e-651c-4530-8f22-64933e873db3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [70ea5272-e026-4783-962d-868e9a2ae008] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45852. Feb 15 03:08:41.881236 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-93ca813e-651c-4530-8f22-64933e873db3 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740853904" status: 204 len: 0 microversion: 2.20 time: 1.041811 Feb 15 03:08:41.885572 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 335/667] 10.222.0.24 () {60 vars in 1261 bytes} [Tue Feb 15 03:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740853904 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 15 03:08:42.076951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-46bb0aac-1544-4ece-89b1-2d67843141be req-b0e8f023-8f67-4435-847c-766ea9e1898a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92a6fac-d364-4204-833a-75679d2e833f", "name": "network-vif-deleted", "tag": "b9a649f9-fed5-4fb8-833f-5f3e5a7d43db"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:42.079650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:08:42.079650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:08:42.089106 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-46bb0aac-1544-4ece-89b1-2d67843141be req-b0e8f023-8f67-4435-847c-766ea9e1898a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:42.090115 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-46bb0aac-1544-4ece-89b1-2d67843141be req-b0e8f023-8f67-4435-847c-766ea9e1898a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:42.104413 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-46bb0aac-1544-4ece-89b1-2d67843141be req-b0e8f023-8f67-4435-847c-766ea9e1898a service nova] Creating event network-vif-deleted:b9a649f9-fed5-4fb8-833f-5f3e5a7d43db for instance e92a6fac-d364-4204-833a-75679d2e833f on hv-cinder-82808 Feb 15 03:08:42.122714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-46bb0aac-1544-4ece-89b1-2d67843141be req-b0e8f023-8f67-4435-847c-766ea9e1898a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050696 Feb 15 03:08:42.125146 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 333/668] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:42.650696 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:42.651926 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:42.660611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:42.661357 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:42.662545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:42.663235 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:42.680226 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] HTTP exception thrown: Instance e92a6fac-d364-4204-833a-75679d2e833f could not be found. Feb 15 03:08:42.681741 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Returning 404 to user: Instance e92a6fac-d364-4204-833a-75679d2e833f could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:42.683529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f95009bc-54fb-46db-ac28-56471f2ffd72 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 404 len: 111 microversion: 2.1 time: 0.037049 Feb 15 03:08:42.687939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 336/669] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:42 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:08:42.695483 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a5e5fcc6-5855-47d9-acac-fc3121bc36ce tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '.version_select at 0x7fe75185fca0>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:42.718538 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a5e5fcc6-5855-47d9-acac-fc3121bc36ce tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502714621" status: 202 len: 0 microversion: 2.1 time: 0.028755 Feb 15 03:08:42.723126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 334/670] 10.222.0.24 () {58 vars in 1220 bytes} [Tue Feb 15 03:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502714621 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:08:44.010344 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:44.010942 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:44.017383 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:44.021063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:44.021063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:44.021063 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:44.033662 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] HTTP exception thrown: Instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e could not be found. Feb 15 03:08:44.034456 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Returning 404 to user: Instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:44.035339 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6d10baba-82e5-480d-8087-0e0da5db2dc0 tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 404 len: 111 microversion: 2.20 time: 0.029776 Feb 15 03:08:44.035892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 337/671] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Feb 15 03:08:44 2022] DELETE /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 03:08:44.044115 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:44.044869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:44.051769 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:44.052214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:44.052981 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:44.053445 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:44.066482 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] HTTP exception thrown: Instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e could not be found. Feb 15 03:08:44.067065 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Returning 404 to user: Instance 5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:44.067904 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3019c95a-0462-41ba-9e06-3260be5429fe tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e" status: 404 len: 111 microversion: 2.20 time: 0.027656 Feb 15 03:08:44.068446 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 335/672] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:08:44 2022] GET /compute/v2.1/servers/5e64cb14-f1e9-4be5-a9a4-4d7b9d1f173e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 03:08:45.195361 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:45.196422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:45.202948 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.203441 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.204239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.204656 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.218352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] HTTP exception thrown: Instance 73cd6519-d67b-4635-af86-336ae2fde18b could not be found. Feb 15 03:08:45.218933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Returning 404 to user: Instance 73cd6519-d67b-4635-af86-336ae2fde18b could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:45.219781 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-65538472-df2d-4427-b84c-733e8425c08d tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "DELETE /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 404 len: 111 microversion: 2.20 time: 0.028182 Feb 15 03:08:45.220319 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 338/673] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Feb 15 03:08:45 2022] DELETE /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 15 03:08:45.229169 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:45.229790 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] [instance: 73cd6519-d67b-4635-af86-336ae2fde18b] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:45.236064 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.236528 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.237329 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.237799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.250659 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] HTTP exception thrown: Instance 73cd6519-d67b-4635-af86-336ae2fde18b could not be found. Feb 15 03:08:45.251273 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] Returning 404 to user: Instance 73cd6519-d67b-4635-af86-336ae2fde18b could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:45.252089 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-22d3706d-c63f-4f80-bdd1-8e90d26330bc tempest-AttachVolumeShelveTestJSON-1027603455 tempest-AttachVolumeShelveTestJSON-1027603455-project] 10.222.0.24 "GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b" status: 404 len: 111 microversion: 2.20 time: 0.027420 Feb 15 03:08:45.252629 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 336/674] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Feb 15 03:08:45 2022] GET /compute/v2.1/servers/73cd6519-d67b-4635-af86-336ae2fde18b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 15 03:08:45.684652 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:45.685229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:45.691218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.691684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.692483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.692924 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.707068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] HTTP exception thrown: Instance e92a6fac-d364-4204-833a-75679d2e833f could not be found. Feb 15 03:08:45.707866 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Returning 404 to user: Instance e92a6fac-d364-4204-833a-75679d2e833f could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:45.708539 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-331b9676-40c1-4efb-be5b-11bf8376b5df tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 404 len: 111 microversion: 2.1 time: 0.028276 Feb 15 03:08:45.709092 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 339/675] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:08:45 2022] DELETE /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:08:45.716922 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:45.717531 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: e92a6fac-d364-4204-833a-75679d2e833f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:45.723577 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.724029 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.724805 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:45.725241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:45.738461 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] HTTP exception thrown: Instance e92a6fac-d364-4204-833a-75679d2e833f could not be found. Feb 15 03:08:45.739080 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Returning 404 to user: Instance e92a6fac-d364-4204-833a-75679d2e833f could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:45.739920 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-20849a6f-0557-4abb-9fcf-ce0a743ac0c2 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f" status: 404 len: 111 microversion: 2.1 time: 0.026704 Feb 15 03:08:45.740460 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 337/676] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:45 2022] GET /compute/v2.1/servers/e92a6fac-d364-4204-833a-75679d2e833f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 03:08:46.871662 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:46.872198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:46.878483 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:46.878932 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:46.879736 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:46.880248 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:46.893760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] HTTP exception thrown: Instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 could not be found. Feb 15 03:08:46.894498 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Returning 404 to user: Instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:46.895426 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a2b14645-e195-4910-a93f-a45adcdd53ec tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 404 len: 111 microversion: 2.1 time: 0.028209 Feb 15 03:08:46.895984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 340/677] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:08:46 2022] DELETE /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:08:46.903847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:46.904597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] [instance: 5dda008d-d3be-48d2-b87b-93c578e8d7b9] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:46.910995 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:46.911548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:46.912408 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:46.912931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:46.926782 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] HTTP exception thrown: Instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 could not be found. Feb 15 03:08:46.927401 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] Returning 404 to user: Instance 5dda008d-d3be-48d2-b87b-93c578e8d7b9 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:08:46.928234 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-290204eb-9a48-4468-a535-7436fad83b62 tempest-AttachVolumeTestJSON-1171068577 tempest-AttachVolumeTestJSON-1171068577-project] 10.222.0.24 "GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9" status: 404 len: 111 microversion: 2.1 time: 0.028069 Feb 15 03:08:46.928811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 338/678] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:46 2022] GET /compute/v2.1/servers/5dda008d-d3be-48d2-b87b-93c578e8d7b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:08:51.427460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-249053817", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "80c26300-d1e5-4078-89f2-1322c33f5c26"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:51.488439 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] validate_networks() for [('80c26300-d1e5-4078-89f2-1322c33f5c26', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:08:51.857055 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:08:51.858484 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:08:51.859782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:08:51.860779 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:08:51.861619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:08:51.872965 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:51.873381 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:51.874187 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:51.874598 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:51.894900 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:08:51.899336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for user 9683953226644c249d7f03fc3849d201 and project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:08:51.911819 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:08:51.914198 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:08:51.960079 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-09328dc0-7a80-4b1a-bafd-a227e0f969c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690829 Feb 15 03:08:51.960910 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 341/679] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:08:51.974380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-17e3156e-1724-4cb7-8b50-5cfd00610b8d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:51.975004 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-17e3156e-1724-4cb7-8b50-5cfd00610b8d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:52.036717 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-17e3156e-1724-4cb7-8b50-5cfd00610b8d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:52.044734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-17e3156e-1724-4cb7-8b50-5cfd00610b8d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1217 microversion: 2.1 time: 0.075276 Feb 15 03:08:52.051497 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 339/680] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:51 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:53.065934 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:53.066962 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:53.080808 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:53.081701 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:53.082733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:53.082733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:53.181714 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:53.192553 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-38a4cfd5-7c9e-4ee6-aae1-402df3638122 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1275 microversion: 2.1 time: 0.132791 Feb 15 03:08:53.193249 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 342/681] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:53 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:54.211558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:54.217060 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:54.225581 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:54.226102 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:54.227013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:54.227584 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:54.272335 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-2fc3c455-8ced-416e-b7e5-d9843980492c req-cb703a58-c8e3-4f07-89e0-fa6f63b50b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aead5a24-3243-4ec7-84ef-278969c59aa3", "tag": "13c20667-8479-4873-a718-e79ce6231839"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:08:54.275721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:08:54.275721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:08:54.284780 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-2fc3c455-8ced-416e-b7e5-d9843980492c req-cb703a58-c8e3-4f07-89e0-fa6f63b50b93 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:54.285432 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-2fc3c455-8ced-416e-b7e5-d9843980492c req-cb703a58-c8e3-4f07-89e0-fa6f63b50b93 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:54.298210 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-2fc3c455-8ced-416e-b7e5-d9843980492c req-cb703a58-c8e3-4f07-89e0-fa6f63b50b93 service nova] Creating event network-changed:13c20667-8479-4873-a718-e79ce6231839 for instance aead5a24-3243-4ec7-84ef-278969c59aa3 on hv-cinder-82808 Feb 15 03:08:54.312909 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-2fc3c455-8ced-416e-b7e5-d9843980492c req-cb703a58-c8e3-4f07-89e0-fa6f63b50b93 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043920 Feb 15 03:08:54.314336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 343/682] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:08:54.425740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:54.433318 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f1ed1fd6-dc37-4805-b9d4-869f90ef04bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.225728 Feb 15 03:08:54.434029 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 340/683] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:54 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:55.450923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:55.451691 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:55.457990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:55.458452 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:55.459386 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:55.459721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:55.599512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:55.606940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-78d04ca9-9152-4b00-9dcb-e6fd9e96742d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.160562 Feb 15 03:08:55.607663 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 344/684] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:55 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:56.625294 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:56.625912 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:56.632329 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:56.632784 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:56.633574 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:56.634072 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:56.809367 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:56.816840 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-aabf245f-dd5d-4090-86f0-cb1662710f0d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.196681 Feb 15 03:08:56.817447 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 341/685] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:56 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:08:57.833805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:57.834512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:57.841905 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:57.842365 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:57.843182 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:57.843619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:57.981631 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:57.989074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3cf4504c-69aa-4d92-9029-22bcce90f3db tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.159182 Feb 15 03:08:57.989645 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 345/686] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:57 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:08:59.005772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:08:59.007042 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:08:59.014287 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:59.014737 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:59.015575 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:08:59.016023 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:08:59.170786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:08:59.178300 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c96daaf0-ad0e-40b3-ac38-3980d53aca01 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.176290 Feb 15 03:08:59.178875 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 342/687] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:08:59 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:00.196164 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:00.197048 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:00.204873 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:00.205410 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:00.206205 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:00.206638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:00.217365 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-7a6a1b08-88f5-4b75-8bb9-8b8ec44413a4 req-d83c3198-c43d-4e56-93ed-966989e70e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aead5a24-3243-4ec7-84ef-278969c59aa3", "name": "network-vif-plugged", "status": "completed", "tag": "13c20667-8479-4873-a718-e79ce6231839"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:00.219176 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:00.219176 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:09:00.229438 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-7a6a1b08-88f5-4b75-8bb9-8b8ec44413a4 req-d83c3198-c43d-4e56-93ed-966989e70e23 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:00.229919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-7a6a1b08-88f5-4b75-8bb9-8b8ec44413a4 req-d83c3198-c43d-4e56-93ed-966989e70e23 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:00.242668 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-7a6a1b08-88f5-4b75-8bb9-8b8ec44413a4 req-d83c3198-c43d-4e56-93ed-966989e70e23 service nova] Creating event network-vif-plugged:13c20667-8479-4873-a718-e79ce6231839 for instance aead5a24-3243-4ec7-84ef-278969c59aa3 on hv-cinder-82808 Feb 15 03:09:00.248663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-7a6a1b08-88f5-4b75-8bb9-8b8ec44413a4 req-d83c3198-c43d-4e56-93ed-966989e70e23 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034981 Feb 15 03:09:00.249509 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 343/688] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:00.368460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:00.376366 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-14f766d3-9bf7-4e00-81cc-c309187f43c6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.183810 Feb 15 03:09:00.376945 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 346/689] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:00 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:01.394174 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:01.394782 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:01.401666 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:01.402138 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:01.402937 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:01.403414 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:01.588895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:01.597136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f88ef783-f035-4e62-b368-3d93907d978b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1317 microversion: 2.1 time: 0.206997 Feb 15 03:09:01.597724 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 344/690] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:01 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:02.613508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:02.614216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:02.620868 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:02.621390 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:02.622193 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:02.622632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:02.760880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:02.768664 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a4fe6e72-bf86-4ecb-9a4b-17490804d2fc tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1506 microversion: 2.1 time: 0.158724 Feb 15 03:09:02.769242 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 347/691] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:02 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:04.123197 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7812082c-de64-49ec-b6c3-946e00f08e80"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:04.124247 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:04.130462 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:04.130911 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:04.131727 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:04.132162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:04.358619 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bf640015-a185-4eed-afa9-f9b59133efd2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240513 Feb 15 03:09:04.359416 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 345/692] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:09:04 2022] POST /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:10.871101 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-425869273", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "80c26300-d1e5-4078-89f2-1322c33f5c26"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:10.922634 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] validate_networks() for [('80c26300-d1e5-4078-89f2-1322c33f5c26', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:09:11.302392 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:09:11.303108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:09:11.303400 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:09:11.303722 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:09:11.304160 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:09:11.313755 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:11.314205 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:11.315059 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:11.315550 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:11.334322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:09:11.338817 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for user 9683953226644c249d7f03fc3849d201 and project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:09:11.349770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:09:11.352222 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:09:11.397097 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1b4a5c26-a1d2-4c82-92d5-2b8d4f9aea52 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530065 Feb 15 03:09:11.397736 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 348/693] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:09:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:09:11.408853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-966610b6-1ee3-4006-9a4e-50cdffc11ea5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:11.409548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-966610b6-1ee3-4006-9a4e-50cdffc11ea5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:11.465926 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-966610b6-1ee3-4006-9a4e-50cdffc11ea5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:11.473315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-966610b6-1ee3-4006-9a4e-50cdffc11ea5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1217 microversion: 2.1 time: 0.068953 Feb 15 03:09:11.473971 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 346/694] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:11 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:09:12.491599 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:12.492423 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:12.502682 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:12.502682 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:12.502682 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:12.502682 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:12.577288 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:12.585668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1eb904e4-332b-42d6-bcf3-f0ad035f090f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1275 microversion: 2.1 time: 0.099215 Feb 15 03:09:12.586304 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 349/695] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:12 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:13.602975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:13.604502 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:13.629794 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:13.630373 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:13.631449 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:13.632005 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:13.706713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-b8e60700-07ee-4ecb-a22f-91e46de92629 req-ea51d01c-ec69-41b2-8789-831d128f0225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8", "tag": "854350d2-5cef-4ffb-96db-55273b66b670"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:13.710070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:13.710070 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:09:13.721472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b8e60700-07ee-4ecb-a22f-91e46de92629 req-ea51d01c-ec69-41b2-8789-831d128f0225 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:13.722052 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b8e60700-07ee-4ecb-a22f-91e46de92629 req-ea51d01c-ec69-41b2-8789-831d128f0225 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:13.734559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-b8e60700-07ee-4ecb-a22f-91e46de92629 req-ea51d01c-ec69-41b2-8789-831d128f0225 service nova] Creating event network-changed:854350d2-5cef-4ffb-96db-55273b66b670 for instance 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 on hv-cinder-82808 Feb 15 03:09:13.740363 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-b8e60700-07ee-4ecb-a22f-91e46de92629 req-ea51d01c-ec69-41b2-8789-831d128f0225 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040038 Feb 15 03:09:13.741266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 350/696] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:13.785767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:13.794364 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-eaadb03d-e433-4af8-94e8-c11de273df74 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1317 microversion: 2.1 time: 0.194758 Feb 15 03:09:13.795245 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 347/697] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:13 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:14.812026 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:14.812720 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:14.819119 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:14.819597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:14.820365 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:14.820797 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:14.958572 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:14.966536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cc6e7706-9e62-41ab-914a-7f7156950a19 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1317 microversion: 2.1 time: 0.158493 Feb 15 03:09:14.967103 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 351/698] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:14 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:15.984823 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:15.985538 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:15.992925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:15.993376 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:15.995400 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:15.996005 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:16.137673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:16.145116 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9e245436-ceb5-481e-99dc-e8828d6e9dd5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1317 microversion: 2.1 time: 0.164726 Feb 15 03:09:16.145687 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 348/699] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:15 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:17.161653 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:17.162269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:17.169363 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:17.169907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:17.170828 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:17.171414 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:17.313432 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:17.320631 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6098476f-63e1-4c50-b05d-d3bb53d5f6d2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1317 microversion: 2.1 time: 0.162719 Feb 15 03:09:17.321188 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 352/700] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:17 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:18.325983 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-9d129ad4-3511-4c6b-8d34-7e07c46a5253 req-fde53317-4fb2-41e1-b420-e08d52617683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8", "name": "network-vif-plugged", "status": "completed", "tag": "854350d2-5cef-4ffb-96db-55273b66b670"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:18.327720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:18.327720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:09:18.336950 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-9d129ad4-3511-4c6b-8d34-7e07c46a5253 req-fde53317-4fb2-41e1-b420-e08d52617683 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:18.337400 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-9d129ad4-3511-4c6b-8d34-7e07c46a5253 req-fde53317-4fb2-41e1-b420-e08d52617683 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:18.341922 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:18.342648 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:18.350977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-9d129ad4-3511-4c6b-8d34-7e07c46a5253 req-fde53317-4fb2-41e1-b420-e08d52617683 service nova] Creating event network-vif-plugged:854350d2-5cef-4ffb-96db-55273b66b670 for instance 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 on hv-cinder-82808 Feb 15 03:09:18.354158 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:18.355937 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:18.356474 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-9d129ad4-3511-4c6b-8d34-7e07c46a5253 req-fde53317-4fb2-41e1-b420-e08d52617683 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Feb 15 03:09:18.357098 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 349/701] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:18.357353 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:18.357946 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:18.511586 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:18.518899 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2c127af9-2469-441a-b9f9-82786a37898d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1317 microversion: 2.1 time: 0.184427 Feb 15 03:09:18.519517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 353/702] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:18 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:09:19.536924 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:19.537572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:19.544627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:19.545019 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:19.545807 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:19.546246 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:19.687104 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:19.694451 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-2bb704b3-4a6b-45aa-974e-8b9383ec7288 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1317 microversion: 2.1 time: 0.162054 Feb 15 03:09:19.695008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 350/703] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:19 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:20.711752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:20.712298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:20.718852 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:20.719340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:20.720127 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:20.720566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:20.864872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:20.872124 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c6e042f3-9df9-45e0-baeb-144c85cd51ea tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1506 microversion: 2.1 time: 0.164144 Feb 15 03:09:20.872692 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 354/704] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:20 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:20.888968 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7812082c-de64-49ec-b6c3-946e00f08e80"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:20.890021 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:20.896281 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:20.896735 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:20.897513 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:20.897956 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:20.976008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] HTTP exception thrown: Invalid volume: volume 7812082c-de64-49ec-b6c3-946e00f08e80 is already attached to instances: aead5a24-3243-4ec7-84ef-278969c59aa3 Feb 15 03:09:20.976610 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Returning 400 to user: Invalid volume: volume 7812082c-de64-49ec-b6c3-946e00f08e80 is already attached to instances: aead5a24-3243-4ec7-84ef-278969c59aa3 {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:09:20.977629 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-3f4c6d4f-4e50-413c-a8d3-25a78e3b5f7f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092973 Feb 15 03:09:20.978204 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 351/705] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:09:20 2022] POST /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 03:09:21.038536 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:21.039026 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:21.046128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:21.046578 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:21.047396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:21.047829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:21.126437 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lazy-loading 'services' on Instance uuid aead5a24-3243-4ec7-84ef-278969c59aa3 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:09:21.195769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7050dfb0-79dc-47ca-b55f-f6faaa2ebe9d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments/7812082c-de64-49ec-b6c3-946e00f08e80" status: 202 len: 0 microversion: 2.1 time: 0.160758 Feb 15 03:09:21.196362 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 355/706] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:09:21 2022] DELETE /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments/7812082c-de64-49ec-b6c3-946e00f08e80 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:09:21.207435 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:21.208619 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:21.226301 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:21.226682 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:21.227512 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:21.227951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:21.259420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8fa0ddbf-a55d-4fac-834a-fced8ec4a524 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057011 Feb 15 03:09:21.259981 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 352/707] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:09:21 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:22.272837 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:22.273878 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:22.281587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.282049 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.282857 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.283337 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.313772 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5f534f8c-f837-4137-bac8-b9286fd63e5b tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045570 Feb 15 03:09:22.318905 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 356/708] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:09:22 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:09:22.399480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:22.400639 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:22.409580 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.410319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.411417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.412225 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.447203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:09:22.549314 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-65013770-bddd-4723-befb-5a8d31cf65b1 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 204 len: 0 microversion: 2.1 time: 0.152930 Feb 15 03:09:22.550020 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 353/709] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:09:22 2022] DELETE /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 03:09:22.556614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-480455596", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "80c26300-d1e5-4078-89f2-1322c33f5c26"}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:22.558260 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-d362482a-c62e-456b-91f8-b22834b18624 req-8c7f9d5c-d001-4dbe-82c7-cfb1c485c1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:22.560478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:22.560478 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:09:22.570338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-d362482a-c62e-456b-91f8-b22834b18624 req-8c7f9d5c-d001-4dbe-82c7-cfb1c485c1fa service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.571414 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-d362482a-c62e-456b-91f8-b22834b18624 req-8c7f9d5c-d001-4dbe-82c7-cfb1c485c1fa service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.583622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-d362482a-c62e-456b-91f8-b22834b18624 req-8c7f9d5c-d001-4dbe-82c7-cfb1c485c1fa service nova] Creating event network-changed:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:09:22.589074 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-d362482a-c62e-456b-91f8-b22834b18624 req-8c7f9d5c-d001-4dbe-82c7-cfb1c485c1fa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190651 Feb 15 03:09:22.590564 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 357/710] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:22.601677 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:22.602794 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:22.610603 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.611336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.612367 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:22.612882 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:22.633917 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] validate_networks() for [('80c26300-d1e5-4078-89f2-1322c33f5c26', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:09:22.853435 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:22.867113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-215ce97e-5088-4e51-b976-e72eb5e87f21 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1570 microversion: 2.1 time: 0.270776 Feb 15 03:09:22.868287 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 358/711] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:22 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1570 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:23.058140 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:09:23.058570 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:09:23.059668 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:09:23.060130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:09:23.060499 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:09:23.071572 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:23.071946 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:23.072748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:23.073177 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:23.092257 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:09:23.096256 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for user 9683953226644c249d7f03fc3849d201 and project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:09:23.108688 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:09:23.111109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:09:23.173530 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5ace11e5-77f0-4019-8bb4-e5f5bd15a19a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621962 Feb 15 03:09:23.174179 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 354/712] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:09:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:09:23.184396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fdcd0436-929a-4600-abfb-792c38740588 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:23.185375 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fdcd0436-929a-4600-abfb-792c38740588 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:23.258592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-fdcd0436-929a-4600-abfb-792c38740588 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:23.266632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fdcd0436-929a-4600-abfb-792c38740588 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1217 microversion: 2.1 time: 0.085853 Feb 15 03:09:23.266857 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 359/713] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:23 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:23.886383 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:23.887524 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:23.893738 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:23.894194 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:23.894972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:23.895442 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:24.032011 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:24.039596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8bb8ea30-5eea-4d72-bd7a-28374a9d127d tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1451 microversion: 2.1 time: 0.157359 Feb 15 03:09:24.040165 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 355/714] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:23 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:24.283493 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:24.284123 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:24.291762 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:24.292451 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:24.293901 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:24.294233 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:24.370520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:24.378111 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-31e0cf85-0531-4c18-8379-4806fb83f429 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1277 microversion: 2.1 time: 0.098317 Feb 15 03:09:24.379071 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 360/715] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:24 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:25.056667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:25.057193 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:25.063766 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:25.064253 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:25.064986 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:25.065405 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:25.150517 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7950ed98cda4e27912a90c765e65930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21443331469a45f5b7d064a7f4513743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:25.159568 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-27034f7e-4960-44a9-8ec7-59cedbbb5f45 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 200 len: 1383 microversion: 2.1 time: 0.106518 Feb 15 03:09:25.169934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 356/716] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:25 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 1383 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:25.215632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-b6af2465-c846-4980-b6a5-85f0a35b3105 req-99942857-b7b8-4d2a-b804-33d4dddae459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e816e723-cdff-4e33-91d5-f2225b504193", "name": "network-vif-deleted", "tag": "7f929fa6-5650-4409-8214-1c736d179537"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:25.219544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:25.219544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:09:25.228122 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b6af2465-c846-4980-b6a5-85f0a35b3105 req-99942857-b7b8-4d2a-b804-33d4dddae459 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:25.228576 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b6af2465-c846-4980-b6a5-85f0a35b3105 req-99942857-b7b8-4d2a-b804-33d4dddae459 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:25.243801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-b6af2465-c846-4980-b6a5-85f0a35b3105 req-99942857-b7b8-4d2a-b804-33d4dddae459 service nova] Creating event network-vif-deleted:7f929fa6-5650-4409-8214-1c736d179537 for instance e816e723-cdff-4e33-91d5-f2225b504193 on hv-cinder-82808 Feb 15 03:09:25.250913 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-b6af2465-c846-4980-b6a5-85f0a35b3105 req-99942857-b7b8-4d2a-b804-33d4dddae459 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044148 Feb 15 03:09:25.252505 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 361/717] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:25.396615 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:25.397641 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:25.405696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:25.406701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:25.407618 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:25.408319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:25.585319 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:25.593224 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cbe2db85-153c-4381-a1e4-a43f14926cec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.200585 Feb 15 03:09:25.595052 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 357/718] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:25 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:26.178643 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:26.180464 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] [instance: e816e723-cdff-4e33-91d5-f2225b504193] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:26.188154 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:26.188715 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:26.189671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:26.190288 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:26.209804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] HTTP exception thrown: Instance e816e723-cdff-4e33-91d5-f2225b504193 could not be found. Feb 15 03:09:26.210568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Returning 404 to user: Instance e816e723-cdff-4e33-91d5-f2225b504193 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:09:26.212593 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-57b2da27-8a62-498c-9cbc-815f8b5774de tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193" status: 404 len: 111 microversion: 2.1 time: 0.038649 Feb 15 03:09:26.227698 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 362/719] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:26 2022] GET /compute/v2.1/servers/e816e723-cdff-4e33-91d5-f2225b504193 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:09:26.377701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d7235b75-3949-4cf2-a94b-943ac2d30347 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] Calling method '.version_select at 0x7fe75187a790>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:26.398795 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d7235b75-3949-4cf2-a94b-943ac2d30347 tempest-TestShelveInstance-1007743679 tempest-TestShelveInstance-1007743679-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-385441723" status: 202 len: 0 microversion: 2.1 time: 0.025080 Feb 15 03:09:26.399683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 358/720] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Feb 15 03:09:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-385441723 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:09:26.612627 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:26.613340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:26.619175 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:26.619825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:26.620623 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:26.621067 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:26.888229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:26.895388 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-181a2c3b-338e-4a94-b104-ac8d9189a0bf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.286436 Feb 15 03:09:26.895957 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 363/721] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:26 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:27.268997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-3e472e5f-f2ec-4833-9117-611ee34a10e1 req-e7f1bbb6-f674-4212-ad84-a6e5769b4bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed", "tag": "15a1d8cf-d440-4b64-a436-925f0f69ba5a"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:27.270547 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:27.270547 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:09:27.279112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-3e472e5f-f2ec-4833-9117-611ee34a10e1 req-e7f1bbb6-f674-4212-ad84-a6e5769b4bd5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:27.279822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-3e472e5f-f2ec-4833-9117-611ee34a10e1 req-e7f1bbb6-f674-4212-ad84-a6e5769b4bd5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:27.290728 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-3e472e5f-f2ec-4833-9117-611ee34a10e1 req-e7f1bbb6-f674-4212-ad84-a6e5769b4bd5 service nova] Creating event network-changed:15a1d8cf-d440-4b64-a436-925f0f69ba5a for instance 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed on hv-cinder-82808 Feb 15 03:09:27.296265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-3e472e5f-f2ec-4833-9117-611ee34a10e1 req-e7f1bbb6-f674-4212-ad84-a6e5769b4bd5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031657 Feb 15 03:09:27.297024 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 359/722] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:27.912014 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:27.912716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:27.920638 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:27.921277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:27.922107 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:27.922587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:28.271384 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:28.279125 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6ae823fb-ac1f-4643-8100-bb7f8d0a95cf tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.370677 Feb 15 03:09:28.279635 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 364/723] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:27 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:29.297331 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:29.298046 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:29.304781 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:29.305755 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:29.306907 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:29.307390 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:29.710893 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:29.726352 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c9d893c9-7b4b-4148-b6ab-70f2739c2794 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.433810 Feb 15 03:09:29.727097 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 360/724] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:29 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:30.744004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:30.744637 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:30.753925 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:30.754970 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:30.756206 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:30.756815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:30.903045 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:30.910489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5126ee83-20a2-4a90-85d9-b86090f0b7ec tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.170637 Feb 15 03:09:30.911170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 365/725] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:30 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:31.927705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:31.928837 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:31.936885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:31.937422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:31.938301 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:31.938811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:32.477882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:32.501710 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d9bfcaff-24a6-463d-9697-e288f2b5946c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.577354 Feb 15 03:09:32.502675 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 361/726] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:31 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:09:32.713464 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-335715bd-78c7-43c3-990c-e44929bd593a req-df90b12a-4df7-4fca-a8ba-521972baac3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed", "name": "network-vif-plugged", "status": "completed", "tag": "15a1d8cf-d440-4b64-a436-925f0f69ba5a"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:32.717131 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:32.717131 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:09:32.744216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-335715bd-78c7-43c3-990c-e44929bd593a req-df90b12a-4df7-4fca-a8ba-521972baac3a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:32.745184 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-335715bd-78c7-43c3-990c-e44929bd593a req-df90b12a-4df7-4fca-a8ba-521972baac3a service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:32.758323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-335715bd-78c7-43c3-990c-e44929bd593a req-df90b12a-4df7-4fca-a8ba-521972baac3a service nova] Creating event network-vif-plugged:15a1d8cf-d440-4b64-a436-925f0f69ba5a for instance 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed on hv-cinder-82808 Feb 15 03:09:32.765855 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-335715bd-78c7-43c3-990c-e44929bd593a req-df90b12a-4df7-4fca-a8ba-521972baac3a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057336 Feb 15 03:09:32.766772 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 366/727] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:09:33.520748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:33.521997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:33.529180 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:33.529987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:33.530955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:33.531848 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:33.680015 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:33.688551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bd1eb626-0716-43fb-8ab3-ee91d99c0e9c tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1317 microversion: 2.1 time: 0.172380 Feb 15 03:09:33.689190 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 362/728] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:33 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:34.708211 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:34.709125 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:34.717102 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:34.717562 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:34.718364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:34.718817 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:34.864352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:34.872272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ebbaf467-24e9-4cf1-a418-549e50186708 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1506 microversion: 2.1 time: 0.169402 Feb 15 03:09:34.872835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 367/729] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:34 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:38.295451 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b8bb848-068a-47e2-b211-46ceee8a6f93"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:38.296663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:38.303938 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:38.304391 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:38.305175 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:38.305609 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:38.542765 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f6fbeaa0-5beb-47f6-9aec-e13251a2bd06 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251861 Feb 15 03:09:38.544083 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 363/730] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:09:38 2022] POST /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:44.973055 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b8bb848-068a-47e2-b211-46ceee8a6f93"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:44.974147 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:44.981306 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:44.982995 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:44.983868 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:44.984311 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:45.071416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] HTTP exception thrown: Invalid volume: volume 8b8bb848-068a-47e2-b211-46ceee8a6f93 is already attached to instances: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed Feb 15 03:09:45.072012 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Returning 400 to user: Invalid volume: volume 8b8bb848-068a-47e2-b211-46ceee8a6f93 is already attached to instances: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:09:45.072850 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b7e1e8e8-4cc6-4591-9ff8-4778222955a7 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105529 Feb 15 03:09:45.073598 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 368/731] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:09:44 2022] POST /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 15 03:09:45.134143 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:45.134722 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:45.141512 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:45.141963 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:45.142741 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:45.143180 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:45.273556 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lazy-loading 'services' on Instance uuid 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:09:45.398362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-886087c0-bce1-4732-a77a-efcbd6720576 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments/8b8bb848-068a-47e2-b211-46ceee8a6f93" status: 202 len: 0 microversion: 2.1 time: 0.268708 Feb 15 03:09:45.399486 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 364/732] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:09:45 2022] DELETE /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments/8b8bb848-068a-47e2-b211-46ceee8a6f93 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 15 03:09:45.408561 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:45.409709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:45.419213 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:45.422800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:45.422800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:45.422800 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:45.462804 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dda296f7-3b45-4c49-a7db-6e1443ba2004 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057843 Feb 15 03:09:45.464264 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 369/733] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:09:45 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:09:46.476962 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:46.478095 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:46.487719 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:46.488177 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:46.488979 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:46.489420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:46.536261 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7b13648e-6de4-4868-a98a-41700634f89a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064477 Feb 15 03:09:46.536872 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 365/734] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:09:46 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:09:46.701997 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1082512087", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "80c26300-d1e5-4078-89f2-1322c33f5c26"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:46.765424 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] validate_networks() for [('80c26300-d1e5-4078-89f2-1322c33f5c26', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:09:47.212923 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:09:47.213722 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:09:47.214558 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:09:47.215138 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:09:47.215731 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:09:47.226903 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:47.227724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:47.229137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:47.229802 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:47.249813 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:09:47.254289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Getting quotas for user 9683953226644c249d7f03fc3849d201 and project c9df8848dd31493e86ac9541cb993a90. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:09:47.266965 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:09:47.269678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:09:47.325540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c94fc405-19ba-40ca-95a2-0d441cbc63c2 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627549 Feb 15 03:09:47.326934 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 370/735] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:09:47.340162 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d34e6951-2e24-4d61-a526-c8936a2ab7e9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:47.341772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d34e6951-2e24-4d61-a526-c8936a2ab7e9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:47.431086 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d34e6951-2e24-4d61-a526-c8936a2ab7e9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:47.442630 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d34e6951-2e24-4d61-a526-c8936a2ab7e9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1218 microversion: 2.1 time: 0.109062 Feb 15 03:09:47.444230 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 366/736] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:47 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:48.463120 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:48.464161 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:48.492150 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:48.493615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:48.500566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:48.501035 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:48.615201 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:48.630403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-24dbfea4-5daa-4b3e-b2af-8475a52e2632 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1288 microversion: 2.1 time: 0.170421 Feb 15 03:09:48.631480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 371/737] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:48 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:49.649673 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:49.650934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:49.658719 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:49.659622 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:49.660652 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:49.661267 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:49.844825 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:49.854309 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-62236c5c-d8e7-4e22-a437-5abe5a5e439d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.209170 Feb 15 03:09:49.855416 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 367/738] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:49 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:50.224280 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-5de0cfef-3c75-48fe-aaac-825831796a9a req-6361702a-6f50-493f-ab64-8ec8bfecdf6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b93594-f45e-497d-8526-d7d9461f6ac2", "tag": "c4501df3-e841-4fe0-b687-ba9b9e36b085"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:50.227546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:50.227546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:09:50.237300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-5de0cfef-3c75-48fe-aaac-825831796a9a req-6361702a-6f50-493f-ab64-8ec8bfecdf6d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:50.237723 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-5de0cfef-3c75-48fe-aaac-825831796a9a req-6361702a-6f50-493f-ab64-8ec8bfecdf6d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:50.251007 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-5de0cfef-3c75-48fe-aaac-825831796a9a req-6361702a-6f50-493f-ab64-8ec8bfecdf6d service nova] Creating event network-changed:c4501df3-e841-4fe0-b687-ba9b9e36b085 for instance c7b93594-f45e-497d-8526-d7d9461f6ac2 on hv-cinder-82808 Feb 15 03:09:50.256237 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-5de0cfef-3c75-48fe-aaac-825831796a9a req-6361702a-6f50-493f-ab64-8ec8bfecdf6d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040727 Feb 15 03:09:50.257072 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 372/739] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:50.874021 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:50.876477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:50.884420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:50.885172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:50.887342 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:50.888030 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:51.130212 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:51.148011 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f6b234ca-f540-4439-812c-1e66afb133d8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.279008 Feb 15 03:09:51.148680 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 368/740] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:50 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:09:52.166345 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:52.167053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:52.176701 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:52.177159 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:52.177953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:52.178387 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:52.433815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:52.442403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2613f87d-f11b-4857-b539-4007129e9519 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.280365 Feb 15 03:09:52.442998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 373/741] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:52 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:53.459236 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:53.460496 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:53.468614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:53.469420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:53.470489 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:53.470927 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:53.854134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:53.861787 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-67285c7c-eabf-41b6-8e92-38d5772c7272 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.406229 Feb 15 03:09:53.862402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 369/742] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:53 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:54.886587 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:54.887919 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:54.894848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:54.895577 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:54.896602 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:54.897212 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:55.069304 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:55.077977 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6475be65-cd9d-489e-893c-d20d6dea2d5d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.195125 Feb 15 03:09:55.078568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 374/743] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:54 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:56.096396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:56.097004 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:56.104679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:56.105606 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:56.106697 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:56.107584 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:56.321121 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:56.329696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d22062a5-8a56-4199-a278-fe4396cc150a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.238146 Feb 15 03:09:56.330281 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 370/744] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:56 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:56.914323 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-854a0e71-e1d4-402a-b86a-a05982166281 req-dd1f148f-f80c-456d-ad75-c31cfc1177ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b93594-f45e-497d-8526-d7d9461f6ac2", "name": "network-vif-plugged", "status": "completed", "tag": "c4501df3-e841-4fe0-b687-ba9b9e36b085"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:09:56.915891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:09:56.915891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:09:56.936188 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-854a0e71-e1d4-402a-b86a-a05982166281 req-dd1f148f-f80c-456d-ad75-c31cfc1177ef service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:56.936962 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-854a0e71-e1d4-402a-b86a-a05982166281 req-dd1f148f-f80c-456d-ad75-c31cfc1177ef service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:56.953101 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-854a0e71-e1d4-402a-b86a-a05982166281 req-dd1f148f-f80c-456d-ad75-c31cfc1177ef service nova] Creating event network-vif-plugged:c4501df3-e841-4fe0-b687-ba9b9e36b085 for instance c7b93594-f45e-497d-8526-d7d9461f6ac2 on hv-cinder-82808 Feb 15 03:09:56.964026 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-854a0e71-e1d4-402a-b86a-a05982166281 req-dd1f148f-f80c-456d-ad75-c31cfc1177ef service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053099 Feb 15 03:09:56.965275 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 375/745] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:09:57.345896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:57.347187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:57.353977 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:57.354557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:57.355453 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:57.356105 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:57.509623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:57.523022 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-52cc1b94-6529-4e0c-90e7-0d891c6a5b6f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1318 microversion: 2.1 time: 0.180851 Feb 15 03:09:57.534154 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 371/746] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:57 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:09:58.548127 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:09:58.548840 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:09:58.556267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:58.556731 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:58.558796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:09:58.559269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:09:58.732114 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:09:58.741547 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-975b3aa9-0ba9-403f-af8b-660be12c61c5 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1508 microversion: 2.1 time: 0.202116 Feb 15 03:09:58.743751 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 376/747] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:09:58 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:10:00.287068 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "784765de-86c4-451e-ab8e-99e726d4d0c0"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:00.288589 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:00.298195 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:00.298740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:00.303763 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:00.304429 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:00.685209 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-427158c7-9ad7-49f2-84a4-06673b73161a tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "POST /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405618 Feb 15 03:10:00.689295 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 372/748] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:10:00 2022] POST /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:05.174970 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6f829c7a-4361-40c7-8c50-199009c87048 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Action: 'create', calling method: .version_select at 0x7fe751820ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1227359489"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:05.189534 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-6f829c7a-4361-40c7-8c50-199009c87048 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Getting quotas for project d8db3f56edb64871b762ed40eb609adb. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:10:05.194752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-6f829c7a-4361-40c7-8c50-199009c87048 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Getting quotas for user ec348baa8f1c4b858c197b661d7cc34b and project d8db3f56edb64871b762ed40eb609adb. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:10:05.635186 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-6f829c7a-4361-40c7-8c50-199009c87048 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Getting quotas for project d8db3f56edb64871b762ed40eb609adb. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:10:05.640423 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-6f829c7a-4361-40c7-8c50-199009c87048 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Getting quotas for user ec348baa8f1c4b858c197b661d7cc34b and project d8db3f56edb64871b762ed40eb609adb. Resources: {'key_pairs'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:10:05.656042 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6f829c7a-4361-40c7-8c50-199009c87048 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.484851 Feb 15 03:10:05.656961 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 377/749] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Feb 15 03:10:05 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:05.713514 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-848444413", "imageRef": "b4f51c16-f2e7-4e62-864e-2ebfa594ad3e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1227359489", "networks": [{"uuid": "7c575b76-1c41-4b45-ae76-13dbf8dddc66"}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:05.775841 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] validate_networks() for [('7c575b76-1c41-4b45-ae76-13dbf8dddc66', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:10:06.196603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:10:06.197146 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:10:06.197763 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:10:06.197763 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:10:06.197763 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:10:06.211443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:06.211911 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:06.212774 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:06.213215 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:06.230609 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Getting quotas for project d8db3f56edb64871b762ed40eb609adb. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:10:06.234815 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Getting quotas for user ec348baa8f1c4b858c197b661d7cc34b and project d8db3f56edb64871b762ed40eb609adb. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:10:06.246063 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:10:06.249203 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4f51c16-f2e7-4e62-864e-2ebfa594ad3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:10:06.299961 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e6f336be-d71f-4c80-a522-c0e53d6cf3f5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590956 Feb 15 03:10:06.300614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 373/750] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:10:06.310324 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ef325258-4214-4711-a0b1-379892508517 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:06.311793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ef325258-4214-4711-a0b1-379892508517 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:06.367391 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ef325258-4214-4711-a0b1-379892508517 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:06.384648 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ef325258-4214-4711-a0b1-379892508517 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1258 microversion: 2.1 time: 0.077573 Feb 15 03:10:06.385966 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 378/751] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:06 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:07.411629 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:07.416225 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:07.445399 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:07.446591 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:07.448605 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:07.449592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:07.450499 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:07.450687 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:07.469329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:07.469793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:07.471571 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:07.472053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:07.584964 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lazy-loading 'services' on Instance uuid c7b93594-f45e-497d-8526-d7d9461f6ac2 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:10:07.585763 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:07.600385 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d1d59ffe-7b2a-43ce-87f6-d88b5bafd3bf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1328 microversion: 2.1 time: 0.198093 Feb 15 03:10:07.608689 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 374/752] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:07 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1328 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:07.674591 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-51a654b1-5d35-4790-83d3-b441defca85e tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments/784765de-86c4-451e-ab8e-99e726d4d0c0" status: 202 len: 0 microversion: 2.1 time: 0.233979 Feb 15 03:10:07.675254 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 379/753] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:10:07 2022] DELETE /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments/784765de-86c4-451e-ab8e-99e726d4d0c0 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:10:07.696327 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:07.697343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:07.711188 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:07.712506 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:07.714090 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:07.714841 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:07.783601 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-254359eb-727c-4643-9ffd-16489141deae tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091043 Feb 15 03:10:07.784663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 375/754] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:07 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:08.629980 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:08.631793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:08.642658 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:08.642980 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:08.644003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:08.644519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:08.798154 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:08.799854 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:08.809976 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:08.813488 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:08.814655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:08.816310 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:08.827533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:08.838298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7820adc4-166f-4dd6-be62-f46e4117cf6a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.215440 Feb 15 03:10:08.843227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 380/755] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:08 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:08.862600 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1947c317-10e8-4971-94de-770a6ddcf1bb tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068655 Feb 15 03:10:08.863604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 376/756] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:08 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:09.856815 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:09.858165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:09.865590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:09.866385 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:09.867426 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:09.868094 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:09.874102 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:09.875027 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:09.882062 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:09.882773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:09.883717 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:09.884230 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:09.930525 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-67682497-0d05-41f1-9e1d-ad8ad03971b9 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060457 Feb 15 03:10:09.931401 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 377/757] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:09 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:10:10.010942 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:10.018827 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0b8406a3-1a92-4c9c-85fb-3546917b3008 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.165717 Feb 15 03:10:10.019436 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 381/758] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:09 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:10.942303 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:10.943297 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:10.950483 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:10.950997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:10.952790 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:10.953355 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:10.989516 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c15dd0e5-286c-45e4-bcaa-0d7f12339237 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050900 Feb 15 03:10:10.990107 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 378/759] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:10 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:11.036004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:11.036618 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:11.043466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:11.043935 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:11.044742 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:11.045788 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:11.193120 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:11.202017 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ebba06e2-5e9d-4c9e-bc2b-81152a4483dc tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.169129 Feb 15 03:10:11.203180 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 382/760] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:11 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:12.001221 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:12.002260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:12.009541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:12.010014 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:12.010887 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:12.011464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:12.041930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-989fa472-f973-44e0-91d4-7f4da3a5a596 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Feb 15 03:10:12.042751 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 379/761] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:11 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:12.220321 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:12.221619 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:12.229004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:12.229676 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:12.231011 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:12.232524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:12.376742 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:12.385662 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-afe71dab-fcfd-4f31-a0ae-7002aeaaf0e8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.169797 Feb 15 03:10:12.386251 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 383/762] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:12 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:13.054124 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:13.055026 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:13.061511 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:13.061949 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:13.062731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:13.063172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:13.093355 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4fd8f0b5-6052-4afb-9fdc-a36e678abd57 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Feb 15 03:10:13.093930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 380/763] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:13 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:13.401700 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:13.403340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:13.410789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:13.411368 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:13.412240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:13.412790 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:13.558200 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:13.566940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e6230718-1087-40f3-b292-32378b21e9e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.168897 Feb 15 03:10:13.567668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 384/764] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:13 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:14.125632 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:14.135235 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:14.193103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:14.194583 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:14.197198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:14.198671 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:14.247732 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-39ced50e-591f-408d-b6f8-f62149bdcb67 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144781 Feb 15 03:10:14.248920 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 381/765] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:14 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:14.584320 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:14.584926 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:14.591456 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:14.592598 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:14.593601 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:14.594046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:14.753948 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:14.761784 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d5a3c5a9-4360-4e35-8db6-6afd3a00ae63 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.181022 Feb 15 03:10:14.762462 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 385/766] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:14 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:15.260124 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:15.261048 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:15.267707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:15.268169 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:15.268981 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:15.269678 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:15.304536 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0ee13433-661d-4c11-8136-6184cdcd1b1f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048136 Feb 15 03:10:15.305140 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 382/767] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:15 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:15.778776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:15.780214 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:15.787352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:15.787799 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:15.788639 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:15.789022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:15.943616 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:15.953361 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9619f2d0-e99e-4023-b69f-585f72111a65 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.178051 Feb 15 03:10:15.954600 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 386/768] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:15 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:16.316270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:16.317306 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:16.324415 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:16.324870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:16.325665 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:16.326103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:16.360514 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1398ef67-8656-4be5-821d-7c292fc036e6 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048210 Feb 15 03:10:16.361095 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 383/769] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:16 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:16.970607 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:16.971495 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:16.979458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:16.980361 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:16.981270 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:16.981889 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:17.224966 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:17.234573 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-94bc7d65-f4b8-4aac-906c-6c91953f104f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.267510 Feb 15 03:10:17.235699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 387/770] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:16 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:17.375054 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:17.377975 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:17.388183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:17.388945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:17.390586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:17.391801 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:17.433426 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d281555e-73a8-4ff9-9271-97a789e4e16d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064929 Feb 15 03:10:17.434777 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 384/771] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:10:17 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:10:17.678447 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-f9c9d245-1d4c-4a8b-9182-22757b5a0bcb req-7bd9f37f-1074-4063-bf40-04a16f8a76b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:17.680647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:17.680647 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:10:17.689727 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-f9c9d245-1d4c-4a8b-9182-22757b5a0bcb req-7bd9f37f-1074-4063-bf40-04a16f8a76b1 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:17.694425 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-f9c9d245-1d4c-4a8b-9182-22757b5a0bcb req-7bd9f37f-1074-4063-bf40-04a16f8a76b1 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:17.712285 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-f9c9d245-1d4c-4a8b-9182-22757b5a0bcb req-7bd9f37f-1074-4063-bf40-04a16f8a76b1 service nova] Creating event network-changed:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:10:17.720139 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-f9c9d245-1d4c-4a8b-9182-22757b5a0bcb req-7bd9f37f-1074-4063-bf40-04a16f8a76b1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045276 Feb 15 03:10:17.720842 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 388/772] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:18.259435 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:18.260079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:18.266424 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:18.266867 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:18.267694 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:18.268125 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:18.420869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:18.429060 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-df163870-734a-4163-a524-3f07f5f1d4be tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.181899 Feb 15 03:10:18.429557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 385/773] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:18 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:18.671592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:18.672238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:18.679243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:18.679730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:18.680818 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:18.681376 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:18.709996 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:10:18.808073 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1a1a8ba9-09c0-4c09-b248-963713618063 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 204 len: 0 microversion: 2.1 time: 0.140335 Feb 15 03:10:18.809516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 389/774] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:10:18 2022] DELETE /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:10:18.820112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:18.820748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:18.830896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:18.831503 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:18.832542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:18.832987 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:18.991060 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:18.998743 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-dfcbba00-5c9a-425b-94e2-3ec10fa7ff3d tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1514 microversion: 2.1 time: 0.184555 Feb 15 03:10:18.999371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 386/775] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:18 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:19.449872 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:19.450609 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:19.457739 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:19.458112 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:19.458914 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:19.459402 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:19.599902 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:19.608015 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8b25990e-844e-479e-a0fa-7ee11c6964b5 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.161862 Feb 15 03:10:19.608620 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 390/776] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:19 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:20.016564 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:20.017133 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:20.023433 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:20.023882 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:20.024670 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:20.025103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:20.167851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:20.176142 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e75d5fa9-52d9-496d-b22d-b54e2eb0c151 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1514 microversion: 2.1 time: 0.163876 Feb 15 03:10:20.176726 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 387/777] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:20 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:10:20.625719 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:20.626338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:20.632792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:20.633237 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:20.634018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:20.634458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:20.878825 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:20.892892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-aecd96b5-d23a-45f9-81ab-73ecfb44a5d8 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.270367 Feb 15 03:10:20.894568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 391/778] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:20 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:10:20.965917 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-c0dca2b6-a391-406c-b0ad-89c7133bf9f7 req-fe6d9754-a95e-4311-97f2-575530c67567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b93594-f45e-497d-8526-d7d9461f6ac2", "name": "network-vif-deleted", "tag": "c4501df3-e841-4fe0-b687-ba9b9e36b085"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:20.975109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:20.975109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:10:20.984656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c0dca2b6-a391-406c-b0ad-89c7133bf9f7 req-fe6d9754-a95e-4311-97f2-575530c67567 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:20.985111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c0dca2b6-a391-406c-b0ad-89c7133bf9f7 req-fe6d9754-a95e-4311-97f2-575530c67567 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:20.997811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-c0dca2b6-a391-406c-b0ad-89c7133bf9f7 req-fe6d9754-a95e-4311-97f2-575530c67567 service nova] Creating event network-vif-deleted:c4501df3-e841-4fe0-b687-ba9b9e36b085 for instance c7b93594-f45e-497d-8526-d7d9461f6ac2 on hv-cinder-82808 Feb 15 03:10:21.003786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-c0dca2b6-a391-406c-b0ad-89c7133bf9f7 req-fe6d9754-a95e-4311-97f2-575530c67567 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042175 Feb 15 03:10:21.007586 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 388/779] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:21.193254 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:21.193859 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:21.200796 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:21.201416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:21.202260 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:21.202684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:21.239041 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:21.239586 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:21.240066 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lazy-loading 'fault' on Instance uuid c7b93594-f45e-497d-8526-d7d9461f6ac2 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:10:21.281678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:21.290255 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-3d679891-87de-42a6-87be-b1265fe31405 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 200 len: 1308 microversion: 2.1 time: 0.100670 Feb 15 03:10:21.290854 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 392/780] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:21 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:21.922078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:21.922789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:21.929412 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:21.929855 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:21.930636 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:21.931068 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:22.077396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:22.085320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a263e47d-b4f9-4fd8-a251-a43433b22635 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.168443 Feb 15 03:10:22.085909 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 389/781] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:21 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:22.307497 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:22.308134 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: c7b93594-f45e-497d-8526-d7d9461f6ac2] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:22.315612 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:22.316078 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:22.316867 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:22.317301 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:22.332209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] HTTP exception thrown: Instance c7b93594-f45e-497d-8526-d7d9461f6ac2 could not be found. Feb 15 03:10:22.332812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Returning 404 to user: Instance c7b93594-f45e-497d-8526-d7d9461f6ac2 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:10:22.333655 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2308d97c-cf84-4bcd-a01f-5830607b3e23 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2" status: 404 len: 111 microversion: 2.1 time: 0.029912 Feb 15 03:10:22.334228 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 393/782] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:22 2022] GET /compute/v2.1/servers/c7b93594-f45e-497d-8526-d7d9461f6ac2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:10:22.868867 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-29055678-8702-4641-acfb-8d864e4e5870 req-3adb4472-0299-4cd9-86a7-246cb846e130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "name": "network-vif-plugged", "status": "completed", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:22.870687 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:22.870687 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:10:22.879017 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-29055678-8702-4641-acfb-8d864e4e5870 req-3adb4472-0299-4cd9-86a7-246cb846e130 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:22.879529 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-29055678-8702-4641-acfb-8d864e4e5870 req-3adb4472-0299-4cd9-86a7-246cb846e130 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:22.892336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-29055678-8702-4641-acfb-8d864e4e5870 req-3adb4472-0299-4cd9-86a7-246cb846e130 service nova] Creating event network-vif-plugged:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:10:22.897389 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-29055678-8702-4641-acfb-8d864e4e5870 req-3adb4472-0299-4cd9-86a7-246cb846e130 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Feb 15 03:10:22.897990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 390/783] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:23.106709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:23.108395 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:23.118753 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:23.119622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:23.121003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:23.122026 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:23.281457 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:23.293565 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7116b537-7a5a-436d-b1f0-67535b7a28e4 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1358 microversion: 2.1 time: 0.193828 Feb 15 03:10:23.294238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 394/784] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:23 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:23.489079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:23.489718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:23.496087 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:23.496534 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:23.497324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:23.497755 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:23.525086 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:10:23.609697 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d15c3a08-ee8a-49e1-80c1-693b8b7fe0d3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 204 len: 0 microversion: 2.1 time: 0.124831 Feb 15 03:10:23.610380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 391/785] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:10:23 2022] DELETE /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:10:23.619049 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:23.619703 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:23.626331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:23.626783 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:23.627674 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:23.628111 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:23.767512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:23.774916 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-5fd3b913-eb62-432e-a28b-e9e57ea31228 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1512 microversion: 2.1 time: 0.159575 Feb 15 03:10:23.775514 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 395/786] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:23 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:24.317614 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:24.318244 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:24.324560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.325007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.325803 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.326402 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.479555 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:24.489123 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5e1371c9-9913-4e4e-bf89-dd78aaf88e69 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1549 microversion: 2.1 time: 0.175680 Feb 15 03:10:24.489895 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 392/787] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:24 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:24.510706 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:24.512719 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:24.524277 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.524968 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.525956 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.526517 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.741539 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:24.752291 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-784df3ba-dffb-44a9-8188-9f12a5773a17 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1549 microversion: 2.1 time: 0.249102 Feb 15 03:10:24.752884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 396/788] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:24 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:24.767897 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:24.771218 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:24.771218 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:10:24.772222 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:24.772965 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Searching by: {'deleted': False, 'project_id': 'd8db3f56edb64871b762ed40eb609adb'} {{(pid=116501) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 15 03:10:24.779986 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.780418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.781243 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.781679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.796931 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:24.797962 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:24.808165 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.809309 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.811758 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.812027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.874031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.multi_cell_list [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116501) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 15 03:10:24.975931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bcba1621-b58d-448d-bc72-07c8052d5cf9 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211809 Feb 15 03:10:24.981475 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:24.981644 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 393/789] 10.222.0.24 () {58 vars in 1124 bytes} [Tue Feb 15 03:10:24 2022] GET /compute/v2.1/servers => generated 342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:24.986467 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:24.987078 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:24.990159 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f441ffb1-d5e9-4297-a804-dfa46c5f2bb3 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1512 microversion: 2.1 time: 0.200553 Feb 15 03:10:24.990741 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 397/790] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:24 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:24.996852 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.997308 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:24.998092 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:24.999056 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:25.152040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:25.159803 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7812f88f-3d71-4ba0-8494-e96d1cf0c05f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1549 microversion: 2.1 time: 0.177070 Feb 15 03:10:25.160393 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 394/791] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:24 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:25.806157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-1bf8aef2-df1b-4401-92de-114c00a74e33 req-2e240836-dfca-4381-a56b-2a256ddd153d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed", "name": "network-vif-deleted", "tag": "15a1d8cf-d440-4b64-a436-925f0f69ba5a"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:25.808251 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:25.808251 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:10:25.818348 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-1bf8aef2-df1b-4401-92de-114c00a74e33 req-2e240836-dfca-4381-a56b-2a256ddd153d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:25.818792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-1bf8aef2-df1b-4401-92de-114c00a74e33 req-2e240836-dfca-4381-a56b-2a256ddd153d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:25.835967 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-1bf8aef2-df1b-4401-92de-114c00a74e33 req-2e240836-dfca-4381-a56b-2a256ddd153d service nova] Creating event network-vif-deleted:15a1d8cf-d440-4b64-a436-925f0f69ba5a for instance 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed on hv-cinder-82808 Feb 15 03:10:25.842234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-1bf8aef2-df1b-4401-92de-114c00a74e33 req-2e240836-dfca-4381-a56b-2a256ddd153d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043491 Feb 15 03:10:25.843239 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 398/792] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:26.007045 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:26.007648 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:26.013887 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:26.014888 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:26.015698 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:26.016136 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:26.046696 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:26.047129 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:26.047596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lazy-loading 'fault' on Instance uuid 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:10:26.090322 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:26.097656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8c1570d5-d135-4733-b4bc-a33278f5f959 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 200 len: 1307 microversion: 2.1 time: 0.094429 Feb 15 03:10:26.098478 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 395/793] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:26 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:26.681886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c31a34f4-1da3-4290-93f2-514cf9ed7085"}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:26.683012 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:26.689117 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:26.689570 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:26.690342 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:26.690806 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:26.918590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-faf5297a-5468-47e9-8107-c487d46f990f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240539 Feb 15 03:10:26.919520 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 399/794] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Feb 15 03:10:26 2022] POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:27.114501 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:27.115089 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:27.121390 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:27.121831 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:27.122597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:27.123030 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:27.136915 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] HTTP exception thrown: Instance 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed could not be found. Feb 15 03:10:27.137500 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Returning 404 to user: Instance 3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:10:27.138313 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-941e90e5-8660-4411-8fec-460567a5adb1 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed" status: 404 len: 111 microversion: 2.1 time: 0.027509 Feb 15 03:10:27.138849 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 396/795] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:27 2022] GET /compute/v2.1/servers/3fa4e7f5-71d8-4e9d-8ddb-6bdb624844ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:10:27.148243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:27.148816 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:27.154961 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:27.156128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:27.157170 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:27.157599 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:27.183083 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:10:27.266642 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-c4870eb9-da21-419e-8749-e6984386c4e8 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 204 len: 0 microversion: 2.1 time: 0.122296 Feb 15 03:10:27.270336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 400/796] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:10:27 2022] DELETE /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:10:27.275748 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:27.276418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:27.282373 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:27.282822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:27.283633 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:27.284069 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:27.416041 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:27.423422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-18aa0e2a-b164-4677-b3bd-cbaf63e69730 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1512 microversion: 2.1 time: 0.151372 Feb 15 03:10:27.423990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 397/797] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:27 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:28.440509 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:28.441216 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:28.447608 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:28.448066 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:28.448858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:28.449297 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:28.583519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:28.590718 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9ab57968-f29e-4d11-809e-db28884b9257 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 200 len: 1512 microversion: 2.1 time: 0.154334 Feb 15 03:10:28.591322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 401/798] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:28 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:29.083054 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-9e43f115-b621-40d5-993c-c30fa672b5f8 req-fd67709e-287f-48eb-a3b9-e62f9f482aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8", "name": "network-vif-deleted", "tag": "854350d2-5cef-4ffb-96db-55273b66b670"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:29.086797 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:29.086797 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:10:29.095466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-9e43f115-b621-40d5-993c-c30fa672b5f8 req-fd67709e-287f-48eb-a3b9-e62f9f482aa9 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:29.096231 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-9e43f115-b621-40d5-993c-c30fa672b5f8 req-fd67709e-287f-48eb-a3b9-e62f9f482aa9 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:29.111628 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-9e43f115-b621-40d5-993c-c30fa672b5f8 req-fd67709e-287f-48eb-a3b9-e62f9f482aa9 service nova] Creating event network-vif-deleted:854350d2-5cef-4ffb-96db-55273b66b670 for instance 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 on hv-cinder-82808 Feb 15 03:10:29.116799 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-9e43f115-b621-40d5-993c-c30fa672b5f8 req-fd67709e-287f-48eb-a3b9-e62f9f482aa9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037695 Feb 15 03:10:29.118051 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 398/799] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:29.608817 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:29.609573 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:29.615908 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:29.616364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:29.617135 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:29.617568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:29.631502 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] HTTP exception thrown: Instance 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 could not be found. Feb 15 03:10:29.632092 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Returning 404 to user: Instance 58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:10:29.632912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-45bcc7e2-97d0-448d-94f1-03de227f798f tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8" status: 404 len: 111 microversion: 2.1 time: 0.028104 Feb 15 03:10:29.633460 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 402/800] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:29 2022] GET /compute/v2.1/servers/58d6c592-9a0f-40f8-9dad-05e1cfd2a7a8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:10:30.760112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:30.760705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:30.767548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:30.768008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:30.768834 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:30.769356 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:30.794386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:10:30.867765 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-560faac4-dbe5-42b2-bcb8-d92a02fe31ff tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "DELETE /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 204 len: 0 microversion: 2.1 time: 0.111503 Feb 15 03:10:30.868461 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 399/801] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:10:30 2022] DELETE /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:10:30.876563 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:30.877178 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:30.883485 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:30.883929 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:30.884727 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:30.885159 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:31.019986 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:31.027699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-250a3538-6ac8-4904-ab66-c3ae7d3d8c17 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1512 microversion: 2.1 time: 0.154989 Feb 15 03:10:31.028259 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 403/802] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:30 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:32.045411 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:32.046215 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:32.052627 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:32.053150 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:32.054617 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:32.055210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:32.206219 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:32.213919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ce22be21-b498-4f7f-a9f2-84c156a5e1d0 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1512 microversion: 2.1 time: 0.172485 Feb 15 03:10:32.214826 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 400/803] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:32 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:32.946907 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-9f541562-6ee7-46de-95e9-181f8d5b1944 req-d3e2d254-9b6b-4857-a7ff-583a32264bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aead5a24-3243-4ec7-84ef-278969c59aa3", "name": "network-vif-deleted", "tag": "13c20667-8479-4873-a718-e79ce6231839"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:32.948416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:32.948416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:10:32.959890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-9f541562-6ee7-46de-95e9-181f8d5b1944 req-d3e2d254-9b6b-4857-a7ff-583a32264bff service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:32.960338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-9f541562-6ee7-46de-95e9-181f8d5b1944 req-d3e2d254-9b6b-4857-a7ff-583a32264bff service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:32.972444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-9f541562-6ee7-46de-95e9-181f8d5b1944 req-d3e2d254-9b6b-4857-a7ff-583a32264bff service nova] Creating event network-vif-deleted:13c20667-8479-4873-a718-e79ce6231839 for instance aead5a24-3243-4ec7-84ef-278969c59aa3 on hv-cinder-82808 Feb 15 03:10:32.978312 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-9f541562-6ee7-46de-95e9-181f8d5b1944 req-d3e2d254-9b6b-4857-a7ff-583a32264bff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Feb 15 03:10:32.979006 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 404/804] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:10:33.234815 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:33.235483 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:33.241894 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:33.242343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:33.243137 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:33.243624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:33.277276 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:33.277650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:33.278114 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lazy-loading 'fault' on Instance uuid aead5a24-3243-4ec7-84ef-278969c59aa3 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:10:33.321989 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683953226644c249d7f03fc3849d201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9df8848dd31493e86ac9541cb993a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:33.329352 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bae062fc-9d2c-469c-9295-4a8dd6525cfe tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 200 len: 1307 microversion: 2.1 time: 0.098828 Feb 15 03:10:33.330126 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 401/805] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:33 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:33.421128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:33.422433 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:33.428740 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:33.429185 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:33.429971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:33.430407 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:33.587236 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:33.596351 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8da9d146-9a6e-4a16-91d3-de92311b30c6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1595 microversion: 2.1 time: 0.180079 Feb 15 03:10:33.597322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 405/806] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:33 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1595 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:10:34.349736 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:34.350437 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] [instance: aead5a24-3243-4ec7-84ef-278969c59aa3] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:34.357137 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:34.357596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:34.358394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:34.359366 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:34.373803 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] HTTP exception thrown: Instance aead5a24-3243-4ec7-84ef-278969c59aa3 could not be found. Feb 15 03:10:34.375430 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] Returning 404 to user: Instance aead5a24-3243-4ec7-84ef-278969c59aa3 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:10:34.376278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b5b9aa92-3342-402b-830d-21409e26ea80 tempest-AttachVolumeNegativeTest-1826953278 tempest-AttachVolumeNegativeTest-1826953278-project] 10.222.0.24 "GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3" status: 404 len: 111 microversion: 2.1 time: 0.030587 Feb 15 03:10:34.376841 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 402/807] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:34 2022] GET /compute/v2.1/servers/aead5a24-3243-4ec7-84ef-278969c59aa3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:10:36.016890 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-4722826b-e444-40d5-b1fe-1506881eafea req-338e81bc-2451-4884-824b-d8661591da1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:36.018522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:36.018522 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:10:36.026133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-4722826b-e444-40d5-b1fe-1506881eafea req-338e81bc-2451-4884-824b-d8661591da1d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:36.026639 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-4722826b-e444-40d5-b1fe-1506881eafea req-338e81bc-2451-4884-824b-d8661591da1d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:36.039077 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-4722826b-e444-40d5-b1fe-1506881eafea req-338e81bc-2451-4884-824b-d8661591da1d service nova] Creating event network-changed:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:10:36.044783 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-4722826b-e444-40d5-b1fe-1506881eafea req-338e81bc-2451-4884-824b-d8661591da1d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Feb 15 03:10:36.050034 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 406/808] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:37.344326 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-389114094"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:37.344916 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:37.352192 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:37.352906 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:37.353963 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:37.354404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:37.516305 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.network.security_group_api [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Adding security group b5ca0a7e-0449-4092-91ac-b15830deafaa to port 129ed621-1aa1-4b73-b960-045fa3debb9d Feb 15 03:10:37.959447 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a761e7f7-f8c3-4ced-ac7b-1d84bd7ce4a2 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/action" status: 202 len: 0 microversion: 2.1 time: 0.618944 Feb 15 03:10:37.961481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 403/809] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:10:37 2022] POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:10:37.976002 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-c1a10f06-6d9f-475b-99e3-2d25fab13f61 req-92e3bb55-54fb-4a60-924d-c1ed99572628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:10:37.979284 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:10:37.980108 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:10:37.981718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:10:37.981718 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:10:37.992167 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c1a10f06-6d9f-475b-99e3-2d25fab13f61 req-92e3bb55-54fb-4a60-924d-c1ed99572628 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:37.996013 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:37.996466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:37.997250 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:10:37.997681 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:38.001329 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-c1a10f06-6d9f-475b-99e3-2d25fab13f61 req-92e3bb55-54fb-4a60-924d-c1ed99572628 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:10:38.015605 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-c1a10f06-6d9f-475b-99e3-2d25fab13f61 req-92e3bb55-54fb-4a60-924d-c1ed99572628 service nova] Creating event network-changed:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:10:38.037623 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-c1a10f06-6d9f-475b-99e3-2d25fab13f61 req-92e3bb55-54fb-4a60-924d-c1ed99572628 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066458 Feb 15 03:10:38.039011 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 404/810] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:10:38.274789 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:10:38.284113 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-839515c7-64f0-4c2c-be08-6b662c4d9967 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1760 microversion: 2.1 time: 0.317611 Feb 15 03:10:38.285011 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 407/811] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:10:37 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1760 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:10.193408 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:10.194414 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:10.202122 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:10.202677 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:10.203705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:10.204275 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:10.284603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-2378589d-8d80-4da3-a799-61c5c5ff80fd tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/action" status: 202 len: 0 microversion: 2.1 time: 0.095156 Feb 15 03:11:10.285526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 405/812] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:11:10 2022] POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:11:10.294282 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:10.295004 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:10.306283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:10.308122 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:10.309057 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:10.309665 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:10.570458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:10.581027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-d56bd48d-2377-4863-a2c2-7356d30fd42f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1752 microversion: 2.1 time: 0.290379 Feb 15 03:11:10.581856 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 408/813] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:10 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:11:11.600465 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:11.601077 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:11.607119 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:11.607604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:11.608422 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:11.608849 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:11.760167 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:11.769745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9f0c57cf-9fee-455e-a3bd-d675b22548bb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.174701 Feb 15 03:11:11.770545 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 406/814] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:11 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:12.788767 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:12.789486 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:12.795954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:12.796413 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:12.797191 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:12.797835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:12.945972 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:12.955671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-7a5e43bf-fbdc-4898-a7c4-22f5885b9d9e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.169855 Feb 15 03:11:12.956133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 409/815] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:12 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:13.972484 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:13.973218 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:13.980359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:13.980818 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:13.981599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:13.982027 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:14.136854 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:14.145645 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-da4b84fb-5efb-4b30-b5fc-54d377576df1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.177879 Feb 15 03:11:14.146219 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 407/816] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:13 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:15.161581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:15.162215 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:15.168776 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:15.169228 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:15.170003 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:15.170433 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:15.320017 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:15.327924 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f39af353-e3f3-479e-8fea-738fb1eb9539 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.170203 Feb 15 03:11:15.328500 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 410/817] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:15 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:16.345307 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:16.346870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:16.353241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:16.353697 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:16.354481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:16.354940 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:16.499397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:16.507233 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-445f4e1b-7f10-43d4-af24-1ca71bea3389 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.165544 Feb 15 03:11:16.507798 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 408/818] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:16 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:17.524229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:17.524848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:17.531143 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:17.531628 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:17.532417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:17.532942 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:17.686876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:17.695947 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-75b4ddd8-3d6b-4670-8924-a2433629a6d1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.175566 Feb 15 03:11:17.696526 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 411/819] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:17 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:18.712712 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:18.713327 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:18.719522 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:18.719954 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:18.720940 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:18.721270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:18.910060 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:18.918744 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-a4381151-5e80-4ea8-ad6c-967eac7926df tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.209419 Feb 15 03:11:18.919419 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 409/820] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:18 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:19.935496 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:19.936117 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:19.942531 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:19.942990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:19.943812 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:19.944267 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:20.098488 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:20.106809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-605344c0-475e-474e-8edd-07a1909ad926 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.174903 Feb 15 03:11:20.107412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 412/821] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:19 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:21.124199 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:21.125094 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:21.131611 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:21.132057 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:21.132825 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:21.133258 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:21.277812 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:21.286209 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9487da7d-2880-4c8f-9f6b-dacccd98e9ac tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.165563 Feb 15 03:11:21.286712 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 410/822] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:21 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:22.303244 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:22.303882 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:22.314220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:22.316471 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:22.317458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:22.318098 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:22.522886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:22.531449 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-50ad674f-3c2d-4b2a-8dec-7de51cd88337 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.232477 Feb 15 03:11:22.532027 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 413/823] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:22 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:23.548767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:23.549750 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:23.556898 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:23.557382 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:23.558169 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:23.558600 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:23.729354 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:23.737800 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-1a76cb95-2fa4-43d5-9c1a-b32bf6876fd6 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.192507 Feb 15 03:11:23.738371 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 411/824] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:23 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:24.754858 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:24.755508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:24.761477 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:24.761940 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:24.762717 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:24.763179 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:24.924612 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:24.935490 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-dd4a37be-9c29-4255-aa4a-9a35cd05c8ea tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.184194 Feb 15 03:11:24.936059 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 414/825] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:24 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:25.952624 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:25.953264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:25.959654 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:25.960103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:25.960879 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:25.961320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:26.066835 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-269010549", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "8c63a042-2879-4c38-853b-9d640a8edccc"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:26.113550 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:26.119641 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] validate_networks() for [('8c63a042-2879-4c38-853b-9d640a8edccc', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:11:26.121891 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-52e875f6-af80-4904-811c-5cbf829002fb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.172904 Feb 15 03:11:26.122528 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 412/826] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:25 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:26.451209 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:11:26.451633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:11:26.452227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:11:26.452677 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:11:26.453112 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:11:26.462554 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:26.463005 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:26.463856 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:26.464299 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:26.481336 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Getting quotas for project 1010f07448ec41c5969b952cf35add6a. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:11:26.485325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Getting quotas for user 27deb99734f645bc980ed25a24d86bb9 and project 1010f07448ec41c5969b952cf35add6a. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:11:26.495805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:11:26.498124 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:11:26.543205 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-bcdf0c09-7086-4a31-bbd2-85d981ab6633 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480395 Feb 15 03:11:26.543829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 415/827] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 15 03:11:26.553691 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-fe5b3347-f3e1-48d1-bd84-983e591c6676 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:26.554398 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-fe5b3347-f3e1-48d1-bd84-983e591c6676 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:26.608543 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-fe5b3347-f3e1-48d1-bd84-983e591c6676 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:26.615479 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-fe5b3347-f3e1-48d1-bd84-983e591c6676 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1213 microversion: 2.1 time: 0.065450 Feb 15 03:11:26.616267 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 413/828] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:26 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:27.139011 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:27.139706 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:27.146326 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:27.146779 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:27.147600 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:27.148042 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:27.298597 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:27.306533 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-449e1d30-845e-4d1a-8b55-8fe60dea59db tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.171865 Feb 15 03:11:27.307106 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 416/829] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:27 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:27.633651 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:27.634277 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:27.640132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:27.640615 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:27.641678 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:27.642122 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:27.703992 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:27.712180 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-6f90b7f9-a879-4799-a731-e4bb5f889d43 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1271 microversion: 2.1 time: 0.083523 Feb 15 03:11:27.712766 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 414/830] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:27 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:28.325489 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:28.326310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:28.333797 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:28.334252 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:28.335285 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:28.335728 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:28.613985 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:28.621684 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-35eb1b43-6a7b-4806-9800-219519a497af tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.299865 Feb 15 03:11:28.622269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 417/831] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:28 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:28.729836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:28.730568 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:28.737283 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:28.738307 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:28.739106 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:28.739575 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:28.761906 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-7e0f986f-6e30-4a4b-a590-f40d99a29afd req-22c9fc77-a58b-4e31-9925-799cddaabf42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f4c335-1988-49ed-8ccc-5412a6fdfcdb", "tag": "dbf381c8-7815-47ec-8e2c-8256a9b4c8f7"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:28.763540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:11:28.763540 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:11:28.771469 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7e0f986f-6e30-4a4b-a590-f40d99a29afd req-22c9fc77-a58b-4e31-9925-799cddaabf42 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:28.772228 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7e0f986f-6e30-4a4b-a590-f40d99a29afd req-22c9fc77-a58b-4e31-9925-799cddaabf42 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:28.783700 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-7e0f986f-6e30-4a4b-a590-f40d99a29afd req-22c9fc77-a58b-4e31-9925-799cddaabf42 service nova] Creating event network-changed:dbf381c8-7815-47ec-8e2c-8256a9b4c8f7 for instance 13f4c335-1988-49ed-8ccc-5412a6fdfcdb on hv-cinder-82808 Feb 15 03:11:28.790412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-7e0f986f-6e30-4a4b-a590-f40d99a29afd req-22c9fc77-a58b-4e31-9925-799cddaabf42 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031552 Feb 15 03:11:28.791313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 418/832] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:11:28.896807 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:28.904214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-6ae365de-47d9-4f98-bdea-5a2f4ba3128a tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1313 microversion: 2.1 time: 0.178893 Feb 15 03:11:28.904777 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 415/833] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:28 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:29.639382 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:29.640090 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:29.646419 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:29.646869 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:29.647726 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:29.648168 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:29.795809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:29.804218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2df41613-e0b0-4ecb-a263-a5da9da8fb7b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.170119 Feb 15 03:11:29.804786 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 419/834] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:29 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:29.920886 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:29.921485 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:29.928551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:29.928993 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:29.929758 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:29.930187 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:30.063551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:30.072065 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9c901cc3-89de-4cb0-91db-5bfd92dca0ff tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1313 microversion: 2.1 time: 0.154760 Feb 15 03:11:30.072647 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 416/835] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:29 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:30.822099 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:30.822651 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:30.829352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:30.829806 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:30.830609 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:30.831051 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:31.006312 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:31.014732 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9866d8dd-6794-401a-99bd-8338b02d18f1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1757 microversion: 2.1 time: 0.196517 Feb 15 03:11:31.015508 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 420/836] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:30 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:31.090593 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:31.091370 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:31.099802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:31.100538 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:31.101721 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:31.102280 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:31.268353 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:31.284475 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bfefcf6e-8d08-44f8-a563-678cbba803a4 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1313 microversion: 2.1 time: 0.198664 Feb 15 03:11:31.285397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 417/837] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:31 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:32.033629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:32.034269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:32.041302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:32.041752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:32.042547 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:32.042982 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:32.194975 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:32.203662 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-8bf57307-5b89-4f0c-86ab-427108564895 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1760 microversion: 2.1 time: 0.173269 Feb 15 03:11:32.205071 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 421/838] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:32 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:32.307453 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:32.308018 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:32.314996 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:32.315471 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:32.317430 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:32.317581 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:32.689548 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:32.696945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0fd18427-16d5-4800-a1e2-7e6739414949 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1313 microversion: 2.1 time: 0.393316 Feb 15 03:11:32.697551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 418/839] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:32 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:33.283281 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-9e66db33-244a-4c4a-8020-99574869cffa req-471b8840-11ad-4848-b39a-2c588c3fbfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f4c335-1988-49ed-8ccc-5412a6fdfcdb", "name": "network-vif-plugged", "status": "completed", "tag": "dbf381c8-7815-47ec-8e2c-8256a9b4c8f7"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:33.285196 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:11:33.285196 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:11:33.292697 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-9e66db33-244a-4c4a-8020-99574869cffa req-471b8840-11ad-4848-b39a-2c588c3fbfd9 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:33.293174 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-9e66db33-244a-4c4a-8020-99574869cffa req-471b8840-11ad-4848-b39a-2c588c3fbfd9 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:33.304472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-9e66db33-244a-4c4a-8020-99574869cffa req-471b8840-11ad-4848-b39a-2c588c3fbfd9 service nova] Creating event network-vif-plugged:dbf381c8-7815-47ec-8e2c-8256a9b4c8f7 for instance 13f4c335-1988-49ed-8ccc-5412a6fdfcdb on hv-cinder-82808 Feb 15 03:11:33.309134 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-9e66db33-244a-4c4a-8020-99574869cffa req-471b8840-11ad-4848-b39a-2c588c3fbfd9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Feb 15 03:11:33.309937 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 422/840] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:11:33.713828 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:33.714471 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:33.720964 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:33.721417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:33.722288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:33.722735 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:33.859109 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:33.866964 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b8f2dabd-99ff-4d6a-8891-852b2d96b684 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1313 microversion: 2.1 time: 0.157028 Feb 15 03:11:33.867561 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 419/841] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:33 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:34.885690 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:34.886300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:34.892473 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:34.892928 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:34.893709 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:34.895300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:35.029640 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:35.037157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-48c6b68b-b68e-499c-82d7-a2f3d174b7d2 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1495 microversion: 2.1 time: 0.156470 Feb 15 03:11:35.037733 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 423/842] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:34 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:35.413192 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:35.413732 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:35.420135 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:35.420594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:35.421381 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:35.421822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:35.446568 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:11:35.523033 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-268594a8-7b3f-4bfc-b477-b590e8065974 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "DELETE /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 204 len: 0 microversion: 2.1 time: 0.113862 Feb 15 03:11:35.523650 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 420/843] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:11:35 2022] DELETE /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 15 03:11:35.531668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:35.532282 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:35.539053 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:35.539546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:35.540340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:35.540781 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:35.683704 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:35.691310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6084b51d-ffcc-4450-a662-2523592a722b tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1501 microversion: 2.1 time: 0.163141 Feb 15 03:11:35.691855 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 424/844] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:35 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:36.709221 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:36.709934 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:36.717459 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:36.717459 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:36.717759 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:36.718112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:36.862626 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:36.871013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-458940d8-9e46-4e2e-a92f-eca82d785a11 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 200 len: 1501 microversion: 2.1 time: 0.166232 Feb 15 03:11:36.871659 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 421/845] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:36 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:37.371659 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-3b29a743-1d4c-4350-a14f-ae65ab1d9f61 req-d8e40004-c1d7-4b44-afa4-408e1ac5c788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f4c335-1988-49ed-8ccc-5412a6fdfcdb", "name": "network-vif-deleted", "tag": "dbf381c8-7815-47ec-8e2c-8256a9b4c8f7"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:37.373356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:11:37.373356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:11:37.384056 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3b29a743-1d4c-4350-a14f-ae65ab1d9f61 req-d8e40004-c1d7-4b44-afa4-408e1ac5c788 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:37.384501 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-3b29a743-1d4c-4350-a14f-ae65ab1d9f61 req-d8e40004-c1d7-4b44-afa4-408e1ac5c788 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:37.397306 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-3b29a743-1d4c-4350-a14f-ae65ab1d9f61 req-d8e40004-c1d7-4b44-afa4-408e1ac5c788 service nova] Creating event network-vif-deleted:dbf381c8-7815-47ec-8e2c-8256a9b4c8f7 for instance 13f4c335-1988-49ed-8ccc-5412a6fdfcdb on hv-cinder-82808 Feb 15 03:11:37.402702 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-3b29a743-1d4c-4350-a14f-ae65ab1d9f61 req-d8e40004-c1d7-4b44-afa4-408e1ac5c788 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035212 Feb 15 03:11:37.403348 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 425/846] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:11:37.887906 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:37.888974 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 13f4c335-1988-49ed-8ccc-5412a6fdfcdb] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:37.895749 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:37.896210 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:37.897003 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:37.897442 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:37.910734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] HTTP exception thrown: Instance 13f4c335-1988-49ed-8ccc-5412a6fdfcdb could not be found. Feb 15 03:11:37.911365 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Returning 404 to user: Instance 13f4c335-1988-49ed-8ccc-5412a6fdfcdb could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:11:37.912200 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7b06be3b-34b3-407e-9b91-389b92c218c6 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb" status: 404 len: 111 microversion: 2.1 time: 0.027980 Feb 15 03:11:37.912757 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 422/847] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:37 2022] GET /compute/v2.1/servers/13f4c335-1988-49ed-8ccc-5412a6fdfcdb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:11:37.960980 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-430251256", "imageRef": "4a54732c-fd2f-4908-a466-bed7d0a2b3a7", "flavorRef": "452", "networks": [{"uuid": "8c63a042-2879-4c38-853b-9d640a8edccc"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:38.013516 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] validate_networks() for [('8c63a042-2879-4c38-853b-9d640a8edccc', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:11:38.438668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:11:38.439579 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:11:38.440455 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:11:38.441224 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:11:38.442034 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:11:38.459037 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:38.459878 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:38.461427 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:38.462220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:38.485458 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Getting quotas for project 1010f07448ec41c5969b952cf35add6a. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:11:38.491138 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Getting quotas for user 27deb99734f645bc980ed25a24d86bb9 and project 1010f07448ec41c5969b952cf35add6a. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:11:38.504307 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:11:38.506824 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a54732c-fd2f-4908-a466-bed7d0a2b3a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:11:38.564895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-9cf24ec1-a9c5-4620-bf52-430777b5fae9 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608469 Feb 15 03:11:38.565700 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 426/848] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:11:38.575955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d40a14e4-c2ab-43bc-b902-63f4fd345fce tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:38.576579 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d40a14e4-c2ab-43bc-b902-63f4fd345fce tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:38.631885 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d40a14e4-c2ab-43bc-b902-63f4fd345fce tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:38.638802 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d40a14e4-c2ab-43bc-b902-63f4fd345fce tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1213 microversion: 2.1 time: 0.066449 Feb 15 03:11:38.639584 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 423/849] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:38 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:39.657765 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:39.658590 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:39.665689 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:39.666422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:39.667668 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:39.668364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:39.766084 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:39.774281 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f5325ca9-95db-4319-8232-18702a71a3c7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1271 microversion: 2.1 time: 0.120730 Feb 15 03:11:39.774880 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 427/850] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:39 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:40.792535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:40.793919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:40.802127 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:40.803046 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:40.803997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:40.804521 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:41.006720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:41.016592 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-05484222-3cc6-4a10-bcff-e437b6fa6ebf tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1313 microversion: 2.1 time: 0.228327 Feb 15 03:11:41.017544 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 424/851] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:40 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:11:41.249644 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-ba47e46a-93d5-46e6-9229-c83fbdcf2679 req-9afdb735-0f22-4c3d-9eb1-7a15ec1556b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "774de373-1e95-4ada-87af-ff15c37269a6", "tag": "e63aa707-9f80-4981-8e6e-b54c4cdf684f"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:41.253229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:11:41.253229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:11:41.264630 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ba47e46a-93d5-46e6-9229-c83fbdcf2679 req-9afdb735-0f22-4c3d-9eb1-7a15ec1556b4 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:41.265393 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ba47e46a-93d5-46e6-9229-c83fbdcf2679 req-9afdb735-0f22-4c3d-9eb1-7a15ec1556b4 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:41.286990 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-ba47e46a-93d5-46e6-9229-c83fbdcf2679 req-9afdb735-0f22-4c3d-9eb1-7a15ec1556b4 service nova] Creating event network-changed:e63aa707-9f80-4981-8e6e-b54c4cdf684f for instance 774de373-1e95-4ada-87af-ff15c37269a6 on hv-cinder-82808 Feb 15 03:11:41.295386 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-ba47e46a-93d5-46e6-9229-c83fbdcf2679 req-9afdb735-0f22-4c3d-9eb1-7a15ec1556b4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052323 Feb 15 03:11:41.296877 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 428/852] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:11:42.034664 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:42.035719 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:42.042552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:42.043012 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:42.043846 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:42.044285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:42.210397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:42.223397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d6cb42f4-fb67-4fb8-b91c-559539b125d7 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1313 microversion: 2.1 time: 0.191989 Feb 15 03:11:42.224118 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 425/853] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:42 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:43.242889 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:43.243769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:43.250490 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:43.251224 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:43.252220 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:43.252701 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:43.419665 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:43.431289 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-95eda3fb-3c06-4c88-87f3-d71ad5d3b85e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1313 microversion: 2.1 time: 0.193728 Feb 15 03:11:43.431920 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 429/854] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:43 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:44.448309 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:44.448925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:44.455714 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:44.456034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:44.457471 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:44.458209 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:44.758544 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:44.766246 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-edf0646c-5612-4066-b8af-7cd2a11d737e tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1313 microversion: 2.1 time: 0.321624 Feb 15 03:11:44.766834 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 426/855] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:44 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:45.374843 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-b155d560-d551-4e69-953f-28712039054a req-bc0e1f2b-703e-4d56-9951-2b26d40161d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774de373-1e95-4ada-87af-ff15c37269a6", "name": "network-vif-plugged", "status": "completed", "tag": "e63aa707-9f80-4981-8e6e-b54c4cdf684f"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:45.376444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:11:45.376444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:11:45.385049 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b155d560-d551-4e69-953f-28712039054a req-bc0e1f2b-703e-4d56-9951-2b26d40161d5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:45.385581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-b155d560-d551-4e69-953f-28712039054a req-bc0e1f2b-703e-4d56-9951-2b26d40161d5 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:45.399062 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-b155d560-d551-4e69-953f-28712039054a req-bc0e1f2b-703e-4d56-9951-2b26d40161d5 service nova] Creating event network-vif-plugged:e63aa707-9f80-4981-8e6e-b54c4cdf684f for instance 774de373-1e95-4ada-87af-ff15c37269a6 on hv-cinder-82808 Feb 15 03:11:45.405811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-b155d560-d551-4e69-953f-28712039054a req-bc0e1f2b-703e-4d56-9951-2b26d40161d5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034053 Feb 15 03:11:45.407380 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 430/856] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:11:45.782884 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:45.783481 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:45.790707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:45.791189 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:45.791998 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:45.792443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:45.937922 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:45.945811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-eb7e0d50-bd2d-45a4-b4fe-f6c4b3b2505d tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1313 microversion: 2.1 time: 0.166744 Feb 15 03:11:45.946401 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 427/857] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:45 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:46.964268 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:46.964972 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:46.971449 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:46.971899 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:46.972775 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:46.973424 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:47.132359 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:47.140159 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-cde071d9-b89b-4b52-bc7a-cf19a31137db tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1495 microversion: 2.1 time: 0.180348 Feb 15 03:11:47.140752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 431/858] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:46 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1495 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:11:47.567776 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:47.568479 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:47.574936 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:47.575417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:47.576216 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:47.576658 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:47.604031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:11:47.687040 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-05c1ae26-34a8-4577-ae52-40aac6197f06 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "DELETE /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 204 len: 0 microversion: 2.1 time: 0.123266 Feb 15 03:11:47.687804 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 428/859] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:11:47 2022] DELETE /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:11:47.696700 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:47.697308 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:47.703672 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:47.704440 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:47.704933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:47.705421 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:47.849464 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:47.857444 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e7a07ce4-bcfa-4609-bec5-5f318e029265 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1501 microversion: 2.1 time: 0.164495 Feb 15 03:11:47.858037 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 432/860] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:47 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:11:48.875588 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:48.876317 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:48.882790 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:48.883284 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:48.884085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:48.884535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:49.031604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:49.040132 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-2418a8f7-12c1-4fc4-80dd-129fde27c283 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1501 microversion: 2.1 time: 0.168589 Feb 15 03:11:49.040707 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 429/861] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:48 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:11:49.651653 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-7904ccfe-94c1-46d3-b074-2e3aacda326c req-6bdbae8b-bd41-4f86-8d1d-90e15c891abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774de373-1e95-4ada-87af-ff15c37269a6", "name": "network-vif-deleted", "tag": "e63aa707-9f80-4981-8e6e-b54c4cdf684f"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:11:49.653820 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:11:49.653820 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:11:49.663272 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7904ccfe-94c1-46d3-b074-2e3aacda326c req-6bdbae8b-bd41-4f86-8d1d-90e15c891abf service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:49.663884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-7904ccfe-94c1-46d3-b074-2e3aacda326c req-6bdbae8b-bd41-4f86-8d1d-90e15c891abf service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:49.676636 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-7904ccfe-94c1-46d3-b074-2e3aacda326c req-6bdbae8b-bd41-4f86-8d1d-90e15c891abf service nova] Creating event network-vif-deleted:e63aa707-9f80-4981-8e6e-b54c4cdf684f for instance 774de373-1e95-4ada-87af-ff15c37269a6 on hv-cinder-82808 Feb 15 03:11:49.682476 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-7904ccfe-94c1-46d3-b074-2e3aacda326c req-6bdbae8b-bd41-4f86-8d1d-90e15c891abf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Feb 15 03:11:49.683259 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 433/862] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:11:50.057852 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:50.058472 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:50.065059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:50.065539 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:50.066325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:50.066767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:50.098952 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:50.099546 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:50.099908 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lazy-loading 'fault' on Instance uuid 774de373-1e95-4ada-87af-ff15c37269a6 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:11:50.142745 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27deb99734f645bc980ed25a24d86bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1010f07448ec41c5969b952cf35add6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:11:50.149871 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7a890afd-de4d-42da-9bbb-c6c76d70c724 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 200 len: 1303 microversion: 2.1 time: 0.095783 Feb 15 03:11:50.150451 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 430/863] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:50 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:11:51.168310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:11:51.169010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] [instance: 774de373-1e95-4ada-87af-ff15c37269a6] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:11:51.175538 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:51.175991 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:51.176778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:11:51.177215 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:11:51.190018 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] HTTP exception thrown: Instance 774de373-1e95-4ada-87af-ff15c37269a6 could not be found. Feb 15 03:11:51.190607 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] Returning 404 to user: Instance 774de373-1e95-4ada-87af-ff15c37269a6 could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:11:51.191515 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-ceb4750f-c759-466c-bbc5-339ec7f94c09 tempest-VolumesActionsTest-904011902 tempest-VolumesActionsTest-904011902-project] 10.222.0.24 "GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6" status: 404 len: 111 microversion: 2.1 time: 0.027259 Feb 15 03:11:51.192042 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 434/864] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:11:51 2022] GET /compute/v2.1/servers/774de373-1e95-4ada-87af-ff15c37269a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:12:05.700229 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-389114094"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:05.700892 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:05.707238 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:05.707701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:05.708528 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:05.708965 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:05.871374 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.network.security_group_api [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Removing security group b5ca0a7e-0449-4092-91ac-b15830deafaa from port 129ed621-1aa1-4b73-b960-045fa3debb9d Feb 15 03:12:06.306049 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-37cbd2fd-4b4b-4463-8168-da70bf6c6d7e tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/action" status: 202 len: 0 microversion: 2.1 time: 0.609655 Feb 15 03:12:06.307348 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 431/865] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Feb 15 03:12:05 2022] POST /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:12:06.330269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-c7fd92f0-fd60-4b71-a5ff-884dbff16635 req-00a792ba-6bde-464f-85fb-19166dd06b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:06.332864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:12:06.332864 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:12:06.349480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-c7fd92f0-fd60-4b71-a5ff-884dbff16635 req-00a792ba-6bde-464f-85fb-19166dd06b34 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:06.352376 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-c7fd92f0-fd60-4b71-a5ff-884dbff16635 req-00a792ba-6bde-464f-85fb-19166dd06b34 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:06.388263 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-c7fd92f0-fd60-4b71-a5ff-884dbff16635 req-00a792ba-6bde-464f-85fb-19166dd06b34 service nova] Creating event network-changed:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:12:06.397937 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-c7fd92f0-fd60-4b71-a5ff-884dbff16635 req-00a792ba-6bde-464f-85fb-19166dd06b34 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077628 Feb 15 03:12:06.398541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 435/866] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:12:07.747820 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:07.748390 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:07.756456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:07.757404 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:07.758674 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:07.759386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:07.859515 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.objects.instance [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lazy-loading 'services' on Instance uuid 7643b853-8ead-4d0c-bce3-1a00afc58818 {{(pid=116501) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:12:07.944124 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-6d8c0388-3d71-4d88-8a5a-23962799dc5f tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments/c31a34f4-1da3-4290-93f2-514cf9ed7085" status: 202 len: 0 microversion: 2.1 time: 0.199930 Feb 15 03:12:07.945315 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 432/867] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:12:07 2022] DELETE /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments/c31a34f4-1da3-4290-93f2-514cf9ed7085 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:12:07.954844 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:07.956529 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:07.964315 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:07.965046 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:07.966023 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:07.966645 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:07.999738 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0163ea09-13a6-4e77-a4a4-91a916350791 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048938 Feb 15 03:12:08.000501 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 436/868] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:12:07 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:12:08.423482 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-7987134e-e3d8-4100-8543-fe9c619bd652 req-bcc4b990-86c8-4620-a711-90386945174b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:08.428526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:12:08.428526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:12:08.452733 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-7987134e-e3d8-4100-8543-fe9c619bd652 req-bcc4b990-86c8-4620-a711-90386945174b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:08.453729 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-7987134e-e3d8-4100-8543-fe9c619bd652 req-bcc4b990-86c8-4620-a711-90386945174b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:08.468214 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-7987134e-e3d8-4100-8543-fe9c619bd652 req-bcc4b990-86c8-4620-a711-90386945174b service nova] Creating event network-changed:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:12:08.475824 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-7987134e-e3d8-4100-8543-fe9c619bd652 req-bcc4b990-86c8-4620-a711-90386945174b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062429 Feb 15 03:12:08.477477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 433/869] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:12:09.014853 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:09.015685 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:09.028769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:09.029493 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:09.030325 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:09.031101 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:09.070157 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-769ffdce-4aec-4905-a3f0-7e8d44bb6adf tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061094 Feb 15 03:12:09.071092 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 437/870] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Feb 15 03:12:09 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 15 03:12:09.081742 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:09.082320 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:09.089643 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:09.090099 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:09.090905 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:09.091377 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:09.205916 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] HTTP exception thrown: Instance 7643b853-8ead-4d0c-bce3-1a00afc58818 is not attached to volume c31a34f4-1da3-4290-93f2-514cf9ed7085 Feb 15 03:12:09.207246 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Returning 404 to user: Instance 7643b853-8ead-4d0c-bce3-1a00afc58818 is not attached to volume c31a34f4-1da3-4290-93f2-514cf9ed7085 {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:12:09.209710 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4e925577-6338-4781-822c-83dda064cfc1 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments/c31a34f4-1da3-4290-93f2-514cf9ed7085" status: 404 len: 154 microversion: 2.1 time: 0.132100 Feb 15 03:12:09.210915 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 434/871] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Feb 15 03:12:09 2022] DELETE /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818/os-volume_attachments/c31a34f4-1da3-4290-93f2-514cf9ed7085 => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 15 03:12:10.378792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:10.379364 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:10.386343 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:10.386801 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:10.387620 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:10.388064 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:10.412377 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:12:10.490242 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-eadef85a-3bb0-40ca-adf3-639d5b0a6b41 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 204 len: 0 microversion: 2.1 time: 0.114239 Feb 15 03:12:10.491201 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 438/872] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:12:10 2022] DELETE /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:12:10.499612 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:10.500239 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:10.507625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:10.507865 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:10.508655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:10.509100 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:10.653112 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:10.661805 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c27d2505-4ac8-43c5-b167-e5996405854a tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1555 microversion: 2.1 time: 0.165964 Feb 15 03:12:10.662448 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 435/873] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:10 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:12:11.681420 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:11.682218 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:11.688592 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:11.689038 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:11.689805 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:11.690236 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:11.825713 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:11.833219 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-bb363331-eaa5-40f2-8990-3829314a9ddb tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1555 microversion: 2.1 time: 0.156390 Feb 15 03:12:11.833799 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 439/874] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:11 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:12.636264 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-d242e6c3-7cf9-4daf-a2eb-02d4ddfd94a3 req-6e531005-fecb-465b-90dd-48a27095672d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7643b853-8ead-4d0c-bce3-1a00afc58818", "name": "network-vif-deleted", "tag": "129ed621-1aa1-4b73-b960-045fa3debb9d"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:12.638705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:12:12.638705 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:12:12.647969 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-d242e6c3-7cf9-4daf-a2eb-02d4ddfd94a3 req-6e531005-fecb-465b-90dd-48a27095672d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:12.648461 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-d242e6c3-7cf9-4daf-a2eb-02d4ddfd94a3 req-6e531005-fecb-465b-90dd-48a27095672d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:12.660260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-d242e6c3-7cf9-4daf-a2eb-02d4ddfd94a3 req-6e531005-fecb-465b-90dd-48a27095672d service nova] Creating event network-vif-deleted:129ed621-1aa1-4b73-b960-045fa3debb9d for instance 7643b853-8ead-4d0c-bce3-1a00afc58818 on hv-cinder-82808 Feb 15 03:12:12.666260 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-d242e6c3-7cf9-4daf-a2eb-02d4ddfd94a3 req-6e531005-fecb-465b-90dd-48a27095672d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Feb 15 03:12:12.666871 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 436/875] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:12:12.849795 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:12.850461 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:12.856949 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:12.857480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:12.858300 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:12.858752 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:12.889392 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:12.889848 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:12.890298 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lazy-loading 'fault' on Instance uuid 7643b853-8ead-4d0c-bce3-1a00afc58818 {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:12:12.937313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec348baa8f1c4b858c197b661d7cc34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8db3f56edb64871b762ed40eb609adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:12.946740 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-32fca40f-2185-4b83-a002-cb1574239447 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 200 len: 1348 microversion: 2.1 time: 0.100560 Feb 15 03:12:12.947467 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 440/876] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:12 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:13.965059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:13.965753 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] [instance: 7643b853-8ead-4d0c-bce3-1a00afc58818] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:13.971919 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:13.972395 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:13.973283 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:13.974111 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:13.987511 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] HTTP exception thrown: Instance 7643b853-8ead-4d0c-bce3-1a00afc58818 could not be found. Feb 15 03:12:13.988130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Returning 404 to user: Instance 7643b853-8ead-4d0c-bce3-1a00afc58818 could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:12:13.989008 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bccc2805-b852-4d24-b56e-a649ac6c57f0 tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818" status: 404 len: 111 microversion: 2.1 time: 0.028713 Feb 15 03:12:13.990149 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 437/877] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:13 2022] GET /compute/v2.1/servers/7643b853-8ead-4d0c-bce3-1a00afc58818 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:12:13.998023 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a8edb08f-f598-40ff-9699-db8dc7fcc20b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] Calling method '.version_select at 0x7fe751760700>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:14.015259 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a8edb08f-f598-40ff-9699-db8dc7fcc20b tempest-TestMinimumBasicScenario-34868491 tempest-TestMinimumBasicScenario-34868491-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1227359489" status: 202 len: 0 microversion: 2.1 time: 0.020763 Feb 15 03:12:14.015818 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 441/878] 10.222.0.24 () {58 vars in 1271 bytes} [Tue Feb 15 03:12:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1227359489 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:12:23.443670 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:12:23.444466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: Tue Feb 15 03:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:12:32.549535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-208be01d-69c3-404c-ae95-dfd7a0e12ae5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Action: 'create', calling method: .version_select at 0x7fe75183fdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1926523069"}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:32.564584 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-208be01d-69c3-404c-ae95-dfd7a0e12ae5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:12:32.568457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-208be01d-69c3-404c-ae95-dfd7a0e12ae5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for user 6ed00ebf0d3449349ba249a9b30c8e2c and project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:12:32.959625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-208be01d-69c3-404c-ae95-dfd7a0e12ae5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:12:32.963247 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-208be01d-69c3-404c-ae95-dfd7a0e12ae5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for user 6ed00ebf0d3449349ba249a9b30c8e2c and project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'key_pairs'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:12:32.977551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-208be01d-69c3-404c-ae95-dfd7a0e12ae5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.608233 Feb 15 03:12:32.978357 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 438/879] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Feb 15 03:12:32 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:50.419738 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1853560466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1926523069", "security_groups": [{"name": "tempest-secgroup-smoke-1022001489"}], "block_device_mapping_v2": [{"uuid": "176b44d2-d7c5-4d78-be58-bbdc738597f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "07078048-b221-49e0-9f5a-17366133853f"}]}} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:50.682894 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.network.neutron [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] validate_networks() for [('07078048-b221-49e0-9f5a-17366133853f', None, None, None, None, None)] {{(pid=116500) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:12:51.145227 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Flavor limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:12:51.145651 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Image limits 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:12:51.146126 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Flavor pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:12:51.146535 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Image pref 0:0:0 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:12:51.146947 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.virt.hardware [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:12:51.155953 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:51.156396 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:51.157199 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:51.157633 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:51.173340 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:12:51.177268 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.quota [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for user 6ed00ebf0d3449349ba249a9b30c8e2c and project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'ram', 'cores', 'instances'} {{(pid=116500) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:12:51.234022 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Going to run 1 instances... {{(pid=116500) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:12:51.236425 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='176b44d2-d7c5-4d78-be58-bbdc738597f7',volume_size=None,volume_type=None)] {{(pid=116500) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:12:51.358611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f1624617-c5c4-44cb-b327-3841d4cb68ac tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.943909 Feb 15 03:12:51.359377 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 442/880] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:12:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:12:51.369457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d1eb1e60-56a2-4792-a04d-0ea905b13d42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:51.370234 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d1eb1e60-56a2-4792-a04d-0ea905b13d42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:51.480955 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d1eb1e60-56a2-4792-a04d-0ea905b13d42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:51.487701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d1eb1e60-56a2-4792-a04d-0ea905b13d42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1095 microversion: 2.1 time: 0.122023 Feb 15 03:12:51.488270 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 439/881] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:51 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:52.506036 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:52.506891 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:52.515807 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:52.516273 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:52.517317 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:52.517782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:52.709568 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:52.717725 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b1f3fe23-4c48-4487-bc02-7c369726469c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1211 microversion: 2.1 time: 0.216056 Feb 15 03:12:52.718266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 443/882] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:52 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1211 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:53.734999 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:53.735668 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:53.742007 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:53.742466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:53.743285 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:53.743731 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:53.898667 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:53.906628 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-b2805f81-f0eb-4f19-95d0-10919f4a2f0c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.175447 Feb 15 03:12:53.907225 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 440/883] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:53 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:54.100472 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-e417c9e7-6b90-4a36-b6e1-d647679c9b03 req-6286d32c-18b5-492c-9993-c449959c047c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab59de8-a5cb-4946-9dad-05c0bf3c95ad", "tag": "9c5ea068-0584-47c4-8e17-e1ea70bec43e"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:12:54.102075 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:12:54.102075 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:12:54.109780 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e417c9e7-6b90-4a36-b6e1-d647679c9b03 req-6286d32c-18b5-492c-9993-c449959c047c service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:54.110234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-e417c9e7-6b90-4a36-b6e1-d647679c9b03 req-6286d32c-18b5-492c-9993-c449959c047c service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:54.122729 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-e417c9e7-6b90-4a36-b6e1-d647679c9b03 req-6286d32c-18b5-492c-9993-c449959c047c service nova] Creating event network-changed:9c5ea068-0584-47c4-8e17-e1ea70bec43e for instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad on hv-cinder-82808 Feb 15 03:12:54.127927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-e417c9e7-6b90-4a36-b6e1-d647679c9b03 req-6286d32c-18b5-492c-9993-c449959c047c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105436 Feb 15 03:12:54.128720 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 444/884] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:12:54.925487 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:54.926110 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:54.932363 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:54.932822 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:54.933679 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:54.934558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:55.069198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:55.077134 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9a214b4a-34f2-4d20-846c-adf239d8cf4f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.155318 Feb 15 03:12:55.077688 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 441/885] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:54 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:12:56.094628 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:56.095341 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:56.101428 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:56.101875 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:56.102645 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:56.103077 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:56.239649 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:56.247048 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2e7ffd09-b280-4923-b249-68d4e4e07428 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.156847 Feb 15 03:12:56.247650 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 445/886] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:56 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:57.264380 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:57.264991 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:57.271386 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:57.271843 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:57.272630 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:57.273071 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:57.404208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:57.411490 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0bc8a3a1-e514-4610-aac3-1e249a313a64 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.151519 Feb 15 03:12:57.412060 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 442/887] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:57 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:58.428229 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:58.428896 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:58.435269 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:58.435722 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:58.436504 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:58.436943 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:58.568566 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:58.576573 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fc090ce5-ac54-4dc6-b540-c6673cef3c78 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.152233 Feb 15 03:12:58.577133 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 446/888] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:58 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:12:59.592636 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:12:59.593248 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:12:59.599571 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:59.600029 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:59.600819 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:12:59.601263 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:12:59.737847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:12:59.745092 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bf97eaeb-362a-48b9-851b-43fd1a75f37f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.156236 Feb 15 03:12:59.745657 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 443/889] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:12:59 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:00.763430 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:13:00.764146 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:13:00.770408 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:00.770863 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:00.771699 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:00.772136 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:00.914544 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:13:00.922041 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4b706d05-a8d2-430c-920a-982f272939f1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.162841 Feb 15 03:13:00.922615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 447/890] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:13:00 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:01.939851 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:13:01.940489 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:13:01.946998 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:01.947491 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:01.948281 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:01.948728 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:02.083603 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:13:02.090826 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-355f727b-f5d6-4dc7-b9c0-c519c2e82d41 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.154949 Feb 15 03:13:02.092093 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 444/891] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:13:01 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:03.108770 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:13:03.109377 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:13:03.115664 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:03.116116 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:03.116898 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:03.117337 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:03.250466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:13:03.257765 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-89c1d4dc-6bc9-4c9f-96f2-878d9dde2dab tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.153227 Feb 15 03:13:03.258322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 448/892] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:13:03 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:03.968325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-8c7b4fa5-fc68-4f67-8989-2c7518bbda0e req-bf9fef1d-05a5-4a1e-910f-5fc1c2a0a513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab59de8-a5cb-4946-9dad-05c0bf3c95ad", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ea068-0584-47c4-8e17-e1ea70bec43e"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:13:03.969835 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:13:03.969835 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:13:03.976665 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-8c7b4fa5-fc68-4f67-8989-2c7518bbda0e req-bf9fef1d-05a5-4a1e-910f-5fc1c2a0a513 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:03.977106 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-8c7b4fa5-fc68-4f67-8989-2c7518bbda0e req-bf9fef1d-05a5-4a1e-910f-5fc1c2a0a513 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:03.987914 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-8c7b4fa5-fc68-4f67-8989-2c7518bbda0e req-bf9fef1d-05a5-4a1e-910f-5fc1c2a0a513 service nova] Creating event network-vif-plugged:9c5ea068-0584-47c4-8e17-e1ea70bec43e for instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad on hv-cinder-82808 Feb 15 03:13:03.992838 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-8c7b4fa5-fc68-4f67-8989-2c7518bbda0e req-bf9fef1d-05a5-4a1e-910f-5fc1c2a0a513 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091885 Feb 15 03:13:03.993339 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 445/893] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:13:04.273624 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:13:04.274226 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:13:04.280545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:04.280988 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:04.281760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:04.282192 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:04.414744 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:13:04.422417 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-0c578f1d-a0f0-4edb-b3b9-8f0629e2ebc5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1267 microversion: 2.1 time: 0.152537 Feb 15 03:13:04.422983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 449/894] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:13:04 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:05.439655 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:13:05.440359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:13:05.446511 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:05.446974 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:05.447853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:05.448301 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:05.585336 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:13:05.592855 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-4950215b-0059-47cb-8741-e0f30916871f tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1453 microversion: 2.1 time: 0.158258 Feb 15 03:13:05.593421 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 446/895] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:13:05 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:05.609068 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:13:05.609683 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:13:05.615941 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:05.616394 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:05.617182 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:05.617622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:05.750628 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:13:05.757876 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2029c2a2-c3da-4d18-a1de-3c325a693b2b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1453 microversion: 2.1 time: 0.152994 Feb 15 03:13:05.758446 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 450/896] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:13:05 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:13:07.521811 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-6d45462c-e00a-402e-983c-310a8278779c req-2593f080-0684-4396-a388-30dce036d43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab59de8-a5cb-4946-9dad-05c0bf3c95ad", "tag": "9c5ea068-0584-47c4-8e17-e1ea70bec43e"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:13:07.524876 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:13:07.524876 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:13:07.534361 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-6d45462c-e00a-402e-983c-310a8278779c req-2593f080-0684-4396-a388-30dce036d43d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:13:07.534809 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-6d45462c-e00a-402e-983c-310a8278779c req-2593f080-0684-4396-a388-30dce036d43d service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:13:07.546826 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-6d45462c-e00a-402e-983c-310a8278779c req-2593f080-0684-4396-a388-30dce036d43d service nova] Creating event network-changed:9c5ea068-0584-47c4-8e17-e1ea70bec43e for instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad on hv-cinder-82808 Feb 15 03:13:07.552720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-6d45462c-e00a-402e-983c-310a8278779c req-2593f080-0684-4396-a388-30dce036d43d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039193 Feb 15 03:13:07.553321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 447/897] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:15:02.754616 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:02.755243 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:02.763185 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:02.763655 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:02.764446 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:02.764892 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:02.789787 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:15:02.866817 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-43f73bdf-c3e7-4531-bc15-f12cee3725ed tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 204 len: 0 microversion: 2.1 time: 0.116263 Feb 15 03:15:02.867600 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 451/898] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:15:02 2022] DELETE /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:15:02.877552 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:02.878237 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:02.884333 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:02.884765 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:02.886101 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:02.886613 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:03.022128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:03.029492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-290805b8-c054-4592-a445-121498ba2f35 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1578 microversion: 2.1 time: 0.157310 Feb 15 03:15:03.030046 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 448/899] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:02 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:04.046748 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:04.047505 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:04.053957 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:04.054416 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:04.055223 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:04.055671 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:04.188302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:04.195581 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-eabd8157-6322-4c8f-97f8-f967707a4904 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1578 microversion: 2.1 time: 0.153477 Feb 15 03:15:04.196151 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 452/900] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:04 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:05.223204 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:05.223983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-bf8be4a8-b66c-4e7d-88b5-7bacc4994db9 req-aba7bc4e-3a60-4451-a2cc-1c5a6ecf7ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab59de8-a5cb-4946-9dad-05c0bf3c95ad", "name": "network-vif-deleted", "tag": "9c5ea068-0584-47c4-8e17-e1ea70bec43e"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:15:05.224937 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:05.228730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:15:05.228730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:15:05.236172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:05.236634 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:05.237683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:05.238332 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:05.238687 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-bf8be4a8-b66c-4e7d-88b5-7bacc4994db9 req-aba7bc4e-3a60-4451-a2cc-1c5a6ecf7ed8 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:05.239137 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-bf8be4a8-b66c-4e7d-88b5-7bacc4994db9 req-aba7bc4e-3a60-4451-a2cc-1c5a6ecf7ed8 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:05.253352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-bf8be4a8-b66c-4e7d-88b5-7bacc4994db9 req-aba7bc4e-3a60-4451-a2cc-1c5a6ecf7ed8 service nova] Creating event network-vif-deleted:9c5ea068-0584-47c4-8e17-e1ea70bec43e for instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad on hv-cinder-82808 Feb 15 03:15:05.259424 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-bf8be4a8-b66c-4e7d-88b5-7bacc4994db9 req-aba7bc4e-3a60-4451-a2cc-1c5a6ecf7ed8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040343 Feb 15 03:15:05.260873 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 453/901] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:15:05.323729 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:05.333205 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-51e1926c-402e-41c7-abb0-4ef630425d08 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 200 len: 1510 microversion: 2.1 time: 0.123670 Feb 15 03:15:05.333883 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 449/902] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:05 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 1510 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:06.351474 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:06.352162 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:06.359266 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:06.359711 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:06.360505 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:06.360933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:06.374167 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] HTTP exception thrown: Instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad could not be found. Feb 15 03:15:06.374739 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Returning 404 to user: Instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:15:06.375586 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f800d6d6-60dd-4c34-8bde-d5ed978a8b6e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 404 len: 111 microversion: 2.1 time: 0.028609 Feb 15 03:15:06.376119 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 454/903] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:06 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:15:06.446265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1599853837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1926523069", "security_groups": [{"name": "tempest-secgroup-smoke-1022001489"}], "block_device_mapping_v2": [{"uuid": "176b44d2-d7c5-4d78-be58-bbdc738597f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "07078048-b221-49e0-9f5a-17366133853f"}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:15:06.557990 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] validate_networks() for [('07078048-b221-49e0-9f5a-17366133853f', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:15:07.017701 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:15:07.018167 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:15:07.018670 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:15:07.019087 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:15:07.019535 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:15:07.030417 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:07.030867 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:07.031725 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:07.032165 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:07.048782 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:15:07.052720 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for user 6ed00ebf0d3449349ba249a9b30c8e2c and project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:15:07.108747 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:15:07.110893 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='176b44d2-d7c5-4d78-be58-bbdc738597f7',volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:15:07.235211 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-44ef9143-af10-4410-9f25-78fc9d988389 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791970 Feb 15 03:15:07.235789 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 450/904] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:15:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:15:07.245107 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-fa80bce8-8b53-455d-9160-ba78f363c042 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:07.245724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-fa80bce8-8b53-455d-9160-ba78f363c042 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:07.299329 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-fa80bce8-8b53-455d-9160-ba78f363c042 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:07.305782 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-fa80bce8-8b53-455d-9160-ba78f363c042 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1095 microversion: 2.1 time: 0.064398 Feb 15 03:15:07.306347 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 455/905] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:07 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:08.322928 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:08.324541 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:08.331105 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:08.331599 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:08.332397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:08.332845 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:08.400870 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:08.408288 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-28526f25-3778-4b67-b6c7-b03abe3e0247 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1211 microversion: 2.1 time: 0.089522 Feb 15 03:15:08.408868 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 451/906] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:08 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:09.427724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:09.428338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:09.438238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:09.438847 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:09.439777 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:09.441403 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:09.447055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-23803b23-4a76-4c4b-97da-d19a9ed506b4 req-fe0c7a13-6ffd-4c50-8b5a-e86cab8abe3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c006b407-811b-4423-a969-0bd4391c6d2f", "tag": "4dbcbc72-8f76-488d-8846-bb6e74ce8fba"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:15:09.451274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:15:09.451274 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:15:09.477059 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-23803b23-4a76-4c4b-97da-d19a9ed506b4 req-fe0c7a13-6ffd-4c50-8b5a-e86cab8abe3e service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:09.477442 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-23803b23-4a76-4c4b-97da-d19a9ed506b4 req-fe0c7a13-6ffd-4c50-8b5a-e86cab8abe3e service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:09.490542 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-23803b23-4a76-4c4b-97da-d19a9ed506b4 req-fe0c7a13-6ffd-4c50-8b5a-e86cab8abe3e service nova] Creating event network-changed:4dbcbc72-8f76-488d-8846-bb6e74ce8fba for instance c006b407-811b-4423-a969-0bd4391c6d2f on hv-cinder-82808 Feb 15 03:15:09.496183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-23803b23-4a76-4c4b-97da-d19a9ed506b4 req-fe0c7a13-6ffd-4c50-8b5a-e86cab8abe3e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056269 Feb 15 03:15:09.497104 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 452/907] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:15:09.696791 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:09.704884 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4b2ff9d7-6ac1-49b2-89a5-d396ab6dc82d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.282814 Feb 15 03:15:09.705454 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 456/908] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:09 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:15:10.723123 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:10.723842 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:10.730891 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:10.731397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:10.732184 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:10.732625 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:10.869456 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:10.876704 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cf5085b0-0915-42ec-b9eb-d1e603d72c81 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.158141 Feb 15 03:15:10.877265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 453/909] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:10 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:11.893186 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:11.893817 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:11.900043 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:11.900490 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:11.901256 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:11.902322 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:12.036559 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:12.044331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f9777321-18a4-481d-bbe4-f34b1337c979 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.154761 Feb 15 03:15:12.044895 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 457/910] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:11 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:13.060921 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:13.061475 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:13.067762 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:13.068221 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:13.068997 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:13.069466 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:13.206163 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:13.213545 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-237a8060-e262-4737-8bff-ad65855deeea tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.156463 Feb 15 03:15:13.214740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 454/911] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:13 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:14.230721 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:14.231350 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:14.237933 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:14.238422 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:14.239224 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:14.239663 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:14.374088 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:14.381486 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e6b0658d-f1ff-4c56-a1a2-7514fb751892 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.154602 Feb 15 03:15:14.382050 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 458/912] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:14 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:15.398805 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:15.399452 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:15.406362 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:15.406816 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:15.407636 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:15.408130 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:15.546265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:15.553443 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-f6ea2c23-6c40-47e7-91d6-3edfd2a7d8a5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.158344 Feb 15 03:15:15.554004 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 455/913] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:15 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:16.569927 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:16.570594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:16.577539 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:16.577998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:16.578793 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:16.579262 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:16.718128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:16.725509 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-e44020c1-f741-4f8e-a031-bf1c8e81f30c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.159279 Feb 15 03:15:16.726087 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 459/914] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:16 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:17.742998 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:17.743661 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:17.750480 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:17.750930 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:17.751734 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:17.752167 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:17.885933 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:17.893401 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-7b63931f-52a6-47a4-b4dc-b8b8810120cc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.154143 Feb 15 03:15:17.893974 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 456/915] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:17 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:18.642916 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-ff9bbb35-b9c5-46a7-8e07-674efb592eae req-2fb94b75-076b-4692-a5de-dbd56c5ced54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c006b407-811b-4423-a969-0bd4391c6d2f", "name": "network-vif-plugged", "status": "completed", "tag": "4dbcbc72-8f76-488d-8846-bb6e74ce8fba"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:15:18.645128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:15:18.645128 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:15:18.655138 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ff9bbb35-b9c5-46a7-8e07-674efb592eae req-2fb94b75-076b-4692-a5de-dbd56c5ced54 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:18.655625 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-ff9bbb35-b9c5-46a7-8e07-674efb592eae req-2fb94b75-076b-4692-a5de-dbd56c5ced54 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:18.667640 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-ff9bbb35-b9c5-46a7-8e07-674efb592eae req-2fb94b75-076b-4692-a5de-dbd56c5ced54 service nova] Creating event network-vif-plugged:4dbcbc72-8f76-488d-8846-bb6e74ce8fba for instance c006b407-811b-4423-a969-0bd4391c6d2f on hv-cinder-82808 Feb 15 03:15:18.673348 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-ff9bbb35-b9c5-46a7-8e07-674efb592eae req-2fb94b75-076b-4692-a5de-dbd56c5ced54 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034395 Feb 15 03:15:18.674166 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 460/916] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:15:18.909926 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:18.910573 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:18.917009 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:18.917459 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:18.918238 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:18.918899 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:19.053728 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:19.061692 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-efc94d22-0f38-4255-83f7-fb409f505c67 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1267 microversion: 2.1 time: 0.155480 Feb 15 03:15:19.062271 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 457/917] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:18 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:20.080164 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:20.080852 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:20.087302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:20.087749 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:20.088524 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:20.088954 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:20.224769 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:20.233196 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-14a7dadf-f0b2-4404-b128-4045f30402b3 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1453 microversion: 2.1 time: 0.157000 Feb 15 03:15:20.234012 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 461/918] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:20 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:20.249503 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:15:20.250198 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:15:20.256446 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:20.256896 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:20.257668 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:20.258097 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:20.393931 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:15:20.401278 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-d233cc21-2ad3-4e23-8ef1-f3627ec34d66 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1453 microversion: 2.1 time: 0.156032 Feb 15 03:15:20.401847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 458/919] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:15:20 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:15:22.298730 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-431cd750-1143-4574-b3e1-d8eca345e445 req-83fe71fe-4202-4d1b-80e8-c6cd4c592a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c006b407-811b-4423-a969-0bd4391c6d2f", "tag": "4dbcbc72-8f76-488d-8846-bb6e74ce8fba"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:15:22.300287 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:15:22.300287 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:15:22.307308 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-431cd750-1143-4574-b3e1-d8eca345e445 req-83fe71fe-4202-4d1b-80e8-c6cd4c592a99 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:15:22.307759 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-431cd750-1143-4574-b3e1-d8eca345e445 req-83fe71fe-4202-4d1b-80e8-c6cd4c592a99 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:15:22.318875 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-431cd750-1143-4574-b3e1-d8eca345e445 req-83fe71fe-4202-4d1b-80e8-c6cd4c592a99 service nova] Creating event network-changed:4dbcbc72-8f76-488d-8846-bb6e74ce8fba for instance c006b407-811b-4423-a969-0bd4391c6d2f on hv-cinder-82808 Feb 15 03:15:22.323824 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-431cd750-1143-4574-b3e1-d8eca345e445 req-83fe71fe-4202-4d1b-80e8-c6cd4c592a99 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091521 Feb 15 03:15:22.324541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 462/920] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:15:39.707492 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:15:39.708310 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: Tue Feb 15 03:15:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:16:55.519387 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-609839339", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1926523069", "security_groups": [{"name": "tempest-secgroup-smoke-1022001489"}], "block_device_mapping_v2": [{"uuid": "c5a2706d-5e99-45e9-911b-89b41202a564", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "07078048-b221-49e0-9f5a-17366133853f"}]}} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:16:55.628908 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.network.neutron [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] validate_networks() for [('07078048-b221-49e0-9f5a-17366133853f', None, None, None, None, None)] {{(pid=116501) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 15 03:16:56.002383 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Flavor limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 15 03:16:56.002816 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Image limits 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 15 03:16:56.003346 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Flavor pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 15 03:16:56.003792 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Image pref 0:0:0 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 15 03:16:56.004208 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.virt.hardware [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116501) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 15 03:16:56.014103 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:56.014558 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:56.015418 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:56.015865 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:56.033786 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 15 03:16:56.037836 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.quota [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Getting quotas for user 6ed00ebf0d3449349ba249a9b30c8e2c and project 9f4d896942cb4b5b98ac53863ee23ac7. Resources: {'ram', 'cores', 'instances'} {{(pid=116501) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 15 03:16:56.094683 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Going to run 1 instances... {{(pid=116501) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 15 03:16:56.096893 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5a2706d-5e99-45e9-911b-89b41202a564',volume_size=None,volume_type=None)] {{(pid=116501) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 15 03:16:56.222996 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-5f40127f-fd82-461e-b74c-92a3848a8922 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708205 Feb 15 03:16:56.223675 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 459/921] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Feb 15 03:16:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 15 03:16:56.236130 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-1a852ae5-aa55-4962-9a0c-68f0af4e9a24 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:16:56.236939 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-1a852ae5-aa55-4962-9a0c-68f0af4e9a24 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:16:56.292648 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-1a852ae5-aa55-4962-9a0c-68f0af4e9a24 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:16:56.299356 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-1a852ae5-aa55-4962-9a0c-68f0af4e9a24 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1094 microversion: 2.1 time: 0.069367 Feb 15 03:16:56.300001 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 463/922] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:16:56 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:16:57.316820 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:16:57.317427 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:16:57.325947 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:57.326395 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:57.327201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:57.327656 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:57.389708 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:16:57.397079 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-99ee6382-393d-4226-a5de-aace84d72652 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1210 microversion: 2.1 time: 0.084467 Feb 15 03:16:57.406430 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 460/923] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:16:57 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:16:58.414318 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:16:58.414944 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:16:58.421594 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:58.422049 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:58.422833 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:58.423313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:58.466557 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-ba6785c1-4f0c-46bd-b932-e57d53807b38 req-20e43734-603a-423b-9b1b-623e9bf5ee67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a158328-9bf9-4a5e-a830-986f6492e3cf", "tag": "498206b3-a34c-4197-aa6c-6eae58f04426"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:16:58.468280 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:16:58.468280 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:16:58.504883 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-ba6785c1-4f0c-46bd-b932-e57d53807b38 req-20e43734-603a-423b-9b1b-623e9bf5ee67 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:58.505464 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-ba6785c1-4f0c-46bd-b932-e57d53807b38 req-20e43734-603a-423b-9b1b-623e9bf5ee67 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:58.517166 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-ba6785c1-4f0c-46bd-b932-e57d53807b38 req-20e43734-603a-423b-9b1b-623e9bf5ee67 service nova] Creating event network-changed:498206b3-a34c-4197-aa6c-6eae58f04426 for instance 0a158328-9bf9-4a5e-a830-986f6492e3cf on hv-cinder-82808 Feb 15 03:16:58.524086 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-ba6785c1-4f0c-46bd-b932-e57d53807b38 req-20e43734-603a-423b-9b1b-623e9bf5ee67 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061776 Feb 15 03:16:58.525359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 461/924] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:16:58.708809 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:16:58.717693 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-f261d121-9b92-42b9-b75d-c41b964aab48 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.307695 Feb 15 03:16:58.718541 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 464/925] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:16:58 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:16:59.736913 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:16:59.737630 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:16:59.744072 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:59.744526 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:59.745325 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:16:59.745772 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:16:59.885389 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:16:59.892945 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-ea42b3ba-4050-4d2a-be8c-005992d98c53 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.160859 Feb 15 03:16:59.893512 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 462/926] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:16:59 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:00.910001 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:00.910611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:00.917275 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:00.917725 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:00.918545 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:00.918989 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:01.060952 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:01.069615 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a5c348c8-b837-4aeb-99ca-334194a4071b tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.162435 Feb 15 03:17:01.070211 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 465/927] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:00 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:02.085849 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:02.086410 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:02.093506 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:02.093962 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:02.094756 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:02.095229 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:02.244334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:02.251778 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-eb0e58a7-2656-4861-9766-11d276f47c19 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.169765 Feb 15 03:17:02.252347 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 463/928] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:02 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:03.269238 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:03.269877 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:03.276811 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:03.277304 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:03.278039 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:03.278470 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:03.417302 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:03.424964 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-2b6ded46-e7ef-4bbe-ac98-2aad1b4058d0 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.159325 Feb 15 03:17:03.425548 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 466/929] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:03 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:04.442081 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:04.442691 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:04.449034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:04.449565 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:04.450397 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:04.450853 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:04.590612 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:04.598213 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-0d9465b6-6aed-4a58-b22e-e5c49f9a89e1 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.159684 Feb 15 03:17:04.598794 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 464/930] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:04 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:05.617182 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:05.617737 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:05.623998 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:05.624438 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:05.625201 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:05.625630 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:05.766724 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:05.774352 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-4e13e060-3321-4555-8617-088b65397d74 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.161492 Feb 15 03:17:05.774932 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 467/931] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:05 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:06.791065 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:06.791751 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:06.798037 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:06.798492 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:06.799328 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:06.799779 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:06.947409 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:06.954920 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-c9de1b15-8ae5-4fd1-a3cd-cf8817c522fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.167957 Feb 15 03:17:06.955560 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 465/932] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:06 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:07.971651 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:07.972274 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:07.979519 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:07.979971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:07.980829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:07.981265 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:08.123120 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:08.131080 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-395017f8-09c7-4fba-ba9e-cad60c05c68e tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.163037 Feb 15 03:17:08.131678 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 468/933] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:07 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:17:09.148173 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:09.148771 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:09.156019 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:09.156394 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:09.157202 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:09.157869 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:09.299331 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-c4a8c99c-de33-48a0-b2ef-5a08febc15c3 req-452d387b-de2f-4955-b689-a5f09418398b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a158328-9bf9-4a5e-a830-986f6492e3cf", "name": "network-vif-plugged", "status": "completed", "tag": "498206b3-a34c-4197-aa6c-6eae58f04426"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:17:09.302181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:17:09.302181 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:17:09.307426 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:09.310622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-c4a8c99c-de33-48a0-b2ef-5a08febc15c3 req-452d387b-de2f-4955-b689-a5f09418398b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:09.311066 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-c4a8c99c-de33-48a0-b2ef-5a08febc15c3 req-452d387b-de2f-4955-b689-a5f09418398b service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:09.316334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-388ea16c-05a8-483b-a404-1ff9141ca455 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.172211 Feb 15 03:17:09.317291 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 466/934] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:09 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:09.322984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-c4a8c99c-de33-48a0-b2ef-5a08febc15c3 req-452d387b-de2f-4955-b689-a5f09418398b service nova] Creating event network-vif-plugged:498206b3-a34c-4197-aa6c-6eae58f04426 for instance 0a158328-9bf9-4a5e-a830-986f6492e3cf on hv-cinder-82808 Feb 15 03:17:09.328548 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-c4a8c99c-de33-48a0-b2ef-5a08febc15c3 req-452d387b-de2f-4955-b689-a5f09418398b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Feb 15 03:17:09.329156 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 469/935] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:17:10.333265 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:10.333888 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:10.340344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:10.340800 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:10.341594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:10.342036 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:10.494775 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:10.502334 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-cd20c8e6-8744-4c66-9c17-36e290936adc tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1266 microversion: 2.1 time: 0.172634 Feb 15 03:17:10.502925 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 467/936] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:10 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:11.520818 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:11.521457 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:11.527604 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:11.528064 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:11.528841 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:11.529283 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:11.669106 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:11.677261 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-629a8c07-af08-454f-9fba-46f63f0d0905 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1452 microversion: 2.1 time: 0.161185 Feb 15 03:17:11.677829 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 470/937] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:11 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:11.696120 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:17:11.696120 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:17:11.701597 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:11.702055 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:11.702847 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:11.703324 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:11.851985 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:17:11.860385 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-8e15de00-1709-4749-a621-16350b7698fe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1452 microversion: 2.1 time: 0.170284 Feb 15 03:17:11.861172 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 468/938] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:17:11 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:17:13.743626 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-270a26d2-b4e7-41a9-98cd-720da924a4c5 req-19e2ef8d-58a1-44bb-9162-a1d04cbaa244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a158328-9bf9-4a5e-a830-986f6492e3cf", "tag": "498206b3-a34c-4197-aa6c-6eae58f04426"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:17:13.744629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:17:13.744629 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:17:13.752546 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-270a26d2-b4e7-41a9-98cd-720da924a4c5 req-19e2ef8d-58a1-44bb-9162-a1d04cbaa244 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:17:13.752995 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-270a26d2-b4e7-41a9-98cd-720da924a4c5 req-19e2ef8d-58a1-44bb-9162-a1d04cbaa244 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:17:13.765297 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-270a26d2-b4e7-41a9-98cd-720da924a4c5 req-19e2ef8d-58a1-44bb-9162-a1d04cbaa244 service nova] Creating event network-changed:498206b3-a34c-4197-aa6c-6eae58f04426 for instance 0a158328-9bf9-4a5e-a830-986f6492e3cf on hv-cinder-82808 Feb 15 03:17:13.770595 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-270a26d2-b4e7-41a9-98cd-720da924a4c5 req-19e2ef8d-58a1-44bb-9162-a1d04cbaa244 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031543 Feb 15 03:17:13.771502 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 471/939] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:17:40.289466 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:17:40.290219 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: Tue Feb 15 03:17:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:17:47.810034 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:17:47.810680 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: Tue Feb 15 03:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:18:37.089556 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:37.090241 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:37.092507 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-efe6ac0e-d2c6-4035-bb7d-2b5d8014190d req-c7226d11-abaf-43fd-91bd-ff052c41bf09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a158328-9bf9-4a5e-a830-986f6492e3cf", "tag": "498206b3-a34c-4197-aa6c-6eae58f04426"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:18:37.094853 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:18:37.094853 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:18:37.097344 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:37.097810 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:37.098666 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:37.099345 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:37.104313 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-efe6ac0e-d2c6-4035-bb7d-2b5d8014190d req-c7226d11-abaf-43fd-91bd-ff052c41bf09 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:37.104877 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-efe6ac0e-d2c6-4035-bb7d-2b5d8014190d req-c7226d11-abaf-43fd-91bd-ff052c41bf09 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:37.119632 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-efe6ac0e-d2c6-4035-bb7d-2b5d8014190d req-c7226d11-abaf-43fd-91bd-ff052c41bf09 service nova] Creating event network-changed:498206b3-a34c-4197-aa6c-6eae58f04426 for instance 0a158328-9bf9-4a5e-a830-986f6492e3cf on hv-cinder-82808 Feb 15 03:18:37.126408 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-efe6ac0e-d2c6-4035-bb7d-2b5d8014190d req-c7226d11-abaf-43fd-91bd-ff052c41bf09 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038909 Feb 15 03:18:37.127432 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 472/940] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:18:37.129642 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Going to try to terminate instance {{(pid=116501) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:18:37.214690 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-bed96738-0eb6-492e-bedc-2c88edd58901 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 204 len: 0 microversion: 2.1 time: 0.129408 Feb 15 03:18:37.216254 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 469/941] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:18:37 2022] DELETE /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:18:37.225512 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:37.226234 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:37.233983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:37.234438 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:37.235334 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:37.235778 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:37.744912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:18:37.754688 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-b228cb3d-59cd-4c0b-9709-df5758c09bbe tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1577 microversion: 2.1 time: 0.533534 Feb 15 03:18:37.755504 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 473/942] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:37 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1577 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:18:38.773074 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:38.773839 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:38.780767 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:38.781764 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:38.782013 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:38.782453 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:38.966757 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:18:38.974551 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-310398da-51e7-46d2-a07b-d5aaee5dfd11 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 200 len: 1458 microversion: 2.1 time: 0.205640 Feb 15 03:18:38.975127 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 470/943] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:38 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 1458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 15 03:18:39.272616 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [req-25d6bf86-86fa-4127-8384-f066af6a9eec req-8c9af3d2-1f70-4787-b40c-133d23431d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a158328-9bf9-4a5e-a830-986f6492e3cf", "name": "network-vif-deleted", "tag": "498206b3-a34c-4197-aa6c-6eae58f04426"}]} {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:18:39.274240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:18:39.274240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: warnings.warn(msg) Feb 15 03:18:39.281887 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-25d6bf86-86fa-4127-8384-f066af6a9eec req-8c9af3d2-1f70-4787-b40c-133d23431d61 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:39.282333 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [req-25d6bf86-86fa-4127-8384-f066af6a9eec req-8c9af3d2-1f70-4787-b40c-133d23431d61 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:39.293611 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.compute.server_external_events [req-25d6bf86-86fa-4127-8384-f066af6a9eec req-8c9af3d2-1f70-4787-b40c-133d23431d61 service nova] Creating event network-vif-deleted:498206b3-a34c-4197-aa6c-6eae58f04426 for instance 0a158328-9bf9-4a5e-a830-986f6492e3cf on hv-cinder-82808 Feb 15 03:18:39.298397 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [req-25d6bf86-86fa-4127-8384-f066af6a9eec req-8c9af3d2-1f70-4787-b40c-133d23431d61 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083228 Feb 15 03:18:39.298991 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 474/944] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:18:39.991369 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:39.991988 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 0a158328-9bf9-4a5e-a830-986f6492e3cf] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:39.999201 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:39.999498 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:40.000290 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:40.000740 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:40.014493 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] HTTP exception thrown: Instance 0a158328-9bf9-4a5e-a830-986f6492e3cf could not be found. Feb 15 03:18:40.015085 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Returning 404 to user: Instance 0a158328-9bf9-4a5e-a830-986f6492e3cf could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:18:40.015938 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-affbb62a-5d1f-4472-899b-9e548ca9fb42 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf" status: 404 len: 111 microversion: 2.1 time: 0.028331 Feb 15 03:18:40.016477 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 471/945] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:39 2022] GET /compute/v2.1/servers/0a158328-9bf9-4a5e-a830-986f6492e3cf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:18:43.129290 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:43.130020 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:43.130297 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-61c1dadf-da6f-431d-b4c1-29b4eba87ed7 req-6bf3ec26-bd0b-4ac9-aaf3-cbfebc725463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c006b407-811b-4423-a969-0bd4391c6d2f", "tag": "4dbcbc72-8f76-488d-8846-bb6e74ce8fba"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:18:43.131929 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:18:43.131929 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:18:43.137423 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:43.137974 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:43.138775 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:43.139240 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:43.140321 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-61c1dadf-da6f-431d-b4c1-29b4eba87ed7 req-6bf3ec26-bd0b-4ac9-aaf3-cbfebc725463 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:43.140844 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-61c1dadf-da6f-431d-b4c1-29b4eba87ed7 req-6bf3ec26-bd0b-4ac9-aaf3-cbfebc725463 service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:43.152514 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-61c1dadf-da6f-431d-b4c1-29b4eba87ed7 req-6bf3ec26-bd0b-4ac9-aaf3-cbfebc725463 service nova] Creating event network-changed:4dbcbc72-8f76-488d-8846-bb6e74ce8fba for instance c006b407-811b-4423-a969-0bd4391c6d2f on hv-cinder-82808 Feb 15 03:18:43.158031 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-61c1dadf-da6f-431d-b4c1-29b4eba87ed7 req-6bf3ec26-bd0b-4ac9-aaf3-cbfebc725463 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031441 Feb 15 03:18:43.158972 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 472/946] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 15 03:18:43.167010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Going to try to terminate instance {{(pid=116500) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 15 03:18:43.249984 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-061ba566-7d47-4bd0-932e-eecd031f5cd4 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 204 len: 0 microversion: 2.1 time: 0.125101 Feb 15 03:18:43.250780 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 475/947] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:18:43 2022] DELETE /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 15 03:18:43.260125 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:43.260837 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:43.267686 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:43.268145 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:43.268951 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:43.269396 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:43.415025 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.policy [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116501) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:18:43.423215 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-e977e288-6828-4ba6-baab-3508c486164c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1578 microversion: 2.1 time: 0.167605 Feb 15 03:18:43.423994 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 473/948] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:43 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:18:44.441465 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:44.442161 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:44.448452 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:44.449010 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:44.449792 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:44.450235 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:44.588513 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:18:44.596839 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-93106b41-902e-4f41-a5d0-7ff6e47390b5 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1459 microversion: 2.1 time: 0.159362 Feb 15 03:18:44.597412 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 476/949] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:44 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:18:45.206596 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [req-b407b8f2-cc76-4e7a-8994-33f1e80d0c05 req-6c45a641-77fe-4d39-849a-25ab8d629d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c006b407-811b-4423-a969-0bd4391c6d2f", "name": "network-vif-deleted", "tag": "4dbcbc72-8f76-488d-8846-bb6e74ce8fba"}]} {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 15 03:18:45.208183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 03:18:45.208183 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: warnings.warn(msg) Feb 15 03:18:45.217974 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-b407b8f2-cc76-4e7a-8994-33f1e80d0c05 req-6c45a641-77fe-4d39-849a-25ab8d629d1f service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:45.218420 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [req-b407b8f2-cc76-4e7a-8994-33f1e80d0c05 req-6c45a641-77fe-4d39-849a-25ab8d629d1f service nova] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:45.230927 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.compute.server_external_events [req-b407b8f2-cc76-4e7a-8994-33f1e80d0c05 req-6c45a641-77fe-4d39-849a-25ab8d629d1f service nova] Creating event network-vif-deleted:4dbcbc72-8f76-488d-8846-bb6e74ce8fba for instance c006b407-811b-4423-a969-0bd4391c6d2f on hv-cinder-82808 Feb 15 03:18:45.236880 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [req-b407b8f2-cc76-4e7a-8994-33f1e80d0c05 req-6c45a641-77fe-4d39-849a-25ab8d629d1f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033888 Feb 15 03:18:45.237663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 474/950] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Feb 15 03:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 15 03:18:45.614117 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:45.614786 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:45.621429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:45.621886 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:45.622986 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:45.623459 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:45.657042 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:45.657498 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:45.657987 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.objects.instance [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lazy-loading 'fault' on Instance uuid c006b407-811b-4423-a969-0bd4391c6d2f {{(pid=116500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 15 03:18:45.698124 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.policy [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed00ebf0d3449349ba249a9b30c8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4d896942cb4b5b98ac53863ee23ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116500) authorize /opt/stack/nova/nova/policy.py:199}} Feb 15 03:18:45.707316 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-90415f98-f74a-4802-928e-91d7bf2ff670 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 200 len: 1231 microversion: 2.1 time: 0.096884 Feb 15 03:18:45.707904 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 477/951] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:45 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 15 03:18:46.725457 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:46.726160 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: c006b407-811b-4423-a969-0bd4391c6d2f] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:46.733359 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:46.733813 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:46.734594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:46.735037 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:46.748663 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] HTTP exception thrown: Instance c006b407-811b-4423-a969-0bd4391c6d2f could not be found. Feb 15 03:18:46.749249 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Returning 404 to user: Instance c006b407-811b-4423-a969-0bd4391c6d2f could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:18:46.750071 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-964864e3-f4a2-4cf5-9a92-7fda99cb510c tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f" status: 404 len: 111 microversion: 2.1 time: 0.028754 Feb 15 03:18:46.750604 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 475/952] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:46 2022] GET /compute/v2.1/servers/c006b407-811b-4423-a969-0bd4391c6d2f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:18:47.196429 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:47.196983 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.compute.api [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116500) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:47.203510 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:47.203971 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:47.204760 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:47.205202 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG oslo_concurrency.lockutils [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:47.219182 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.wsgi [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] HTTP exception thrown: Instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad could not be found. Feb 15 03:18:47.219772 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Returning 404 to user: Instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad could not be found. {{(pid=116500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:18:47.220602 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-a06c5d34-ade8-401c-a877-4dfc7d7897ef tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 404 len: 111 microversion: 2.1 time: 0.029078 Feb 15 03:18:47.221153 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 478/953] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Feb 15 03:18:47 2022] DELETE /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:18:47.229002 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '>' {{(pid=116501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:47.230157 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.compute.api [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] [instance: 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad] Fetching instance by UUID {{(pid=116501) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 15 03:18:47.236128 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:47.236575 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:47.237343 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 15 03:18:47.237773 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG oslo_concurrency.lockutils [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Lock "f961b14e-12e5-47a3-bada-8b53b85b0202" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 15 03:18:47.251928 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.wsgi [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] HTTP exception thrown: Instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad could not be found. Feb 15 03:18:47.252510 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: DEBUG nova.api.openstack.wsgi [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Returning 404 to user: Instance 5ab59de8-a5cb-4946-9dad-05c0bf3c95ad could not be found. {{(pid=116501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 15 03:18:47.253326 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO nova.api.openstack.requestlog [None req-9b89b21e-48ad-46cf-965e-7f2cc0fa3c6d tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad" status: 404 len: 111 microversion: 2.1 time: 0.027990 Feb 15 03:18:47.253871 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: [pid: 116501|app: 0|req: 476/954] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Feb 15 03:18:47 2022] GET /compute/v2.1/servers/5ab59de8-a5cb-4946-9dad-05c0bf3c95ad => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 15 03:18:48.536912 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: DEBUG nova.api.openstack.wsgi [None req-6558ecbe-8aed-44df-b819-b3411f376186 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] Calling method '.version_select at 0x7fe7517e8af0>' {{(pid=116500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 15 03:18:48.559480 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO nova.api.openstack.requestlog [None req-6558ecbe-8aed-44df-b819-b3411f376186 tempest-TestVolumeBootPattern-692977377 tempest-TestVolumeBootPattern-692977377-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1926523069" status: 202 len: 0 microversion: 2.1 time: 0.025224 Feb 15 03:18:48.560064 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: [pid: 116500|app: 0|req: 479/955] 10.222.0.24 () {58 vars in 1262 bytes} [Tue Feb 15 03:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1926523069 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 15 03:18:59.716253 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:18:59.716945 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: Tue Feb 15 03:18:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:21:07.820594 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:21:07.821821 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: Tue Feb 15 03:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:22:19.724716 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:22:19.725338 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: Tue Feb 15 03:22:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:22:23.459980 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:22:23.460509 dv-cinder-828085-9-iscsi devstack@n-api.service[116501]: Tue Feb 15 03:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 15 03:24:16.570622 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 15 03:24:16.571223 dv-cinder-828085-9-iscsi devstack@n-api.service[116500]: Tue Feb 15 03:24:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!